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PARTIAL REINFORCEMENT: 


A SELECTIVE REVIEW OF THE LITERATURE SINCE 1950! 


Wis? 
In May, 1950, Jenk and Stanley large class of excluded studies are 
published Partial Reinforce t those which involve a free respond- 
Review and Critique, now a ing situation. This exclusion is purely 
standard reference in the are irbitrary and does not mean that 
very excellence robably i such studies are considered to be of 
hibited other workers the area ss significance, nor that different 
from attempti inotl ‘ ' I f ples necessarily will be re- 
the literature he partial reinfor d for their explanation. Only 
ment literature, hov r, is so large liscrete trial studies are considered, 
and has increased ; ih a ray rimarily because these happen to be 
rate, that it is difficult now to n o! interest to the writer. A re- 
iin a perspective on the w ur ie@V free responding studies is 
The present 1 ' offered, wit badly needed. A very few studies be- 
considerable midatior t fore 1950 are considered either be- 
tempt to poi yu least the major cause of their parametric design or 
results and trend ) 0 t! r importance to theors 
research s paper is organized around the 
empirical variables that have 
investigated in attempts to de- 


Even though 
is long, this review 


not exhaustive. Some studi ne the effects of partial rein- 


t on extinction. The aim in 
1 section has been to deter- 


Tak luded because they we ‘ 


by the writer to be insignif nt, u he dat 
conclusive, or badly cor parametric relations between 
ably other studies perh I ‘ let t ] ind 


} 


response variables. 
ones, simply h ive peel 


studies whose primary purpose 


although the writer has o test a theoretical orientation 
scientious effort to read every 10 ' ] not allow such a determination, 
on partial reiniorcement t j they are considered to be val- 
been published major ychok uable apart from theirtheory. There- 
ical and allied journal I her fore, they, too, are cited in the data 
section. Without their theoretical 
context these studies may appear 


somewhat disjointed, but it is some- 


times salutary to look at data only in 
relation to empirical variables. Other 
script ay inadenuacies reme ase tudies seem most important pri- 


to be attributed to them marily for their contribution to 
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theory and they are considered in the 
theory section. Some, of course, must 
be considered in both sections. Be- 
cause this paper is concerned with ex- 
tinction, acquisition phenomena are 
treated only incidentally 
necessary introduction to this paper 
is a thorough reading of the Jenkins 
and Stanley (1950) paper 
and problems they discuss are 


Perhaps a 


Ihe issues 
not 
taken up again unless there is a clear 
need. 


DATA 
Percentage of reward Following 
their review of the pertinent litera- 
ture, Jenkins and Stanley 
rived at an empirical get 
which stated: “All 
equal, resistance to extinction after 
partial reinforcement is greater than 
that after continuous reinforcement 
when behavior strength is measured 


1950) ar- 
eralization 


other things 


in terms of single responses’ 
Nine years and a. great deal of re- 
search later this generalization still 
stands, than 
ever. Because this law of partial re- 
inforcemen 


perhaps more firmly 


seems so well estab- 
lished, there seems little point here 
in noting those studies 
two reiniorcement 
whose main point has been to demon- 
strate again the PRE (partial rein- 
forcement effect We will be pri- 
marily coricerned in this section with 
studies that have attempted to de- 
termine a parametric law 
Grant and Schipper (1952 
eyelid conditioning situation with a 
light CS and an airpuff UCS and 
counted the percentage of CRs in ac- 
quisition The 
used were 
100°. 
that the 
during 
function of per- 
with the 
the 


involving only 
percentages of 


used an 


and extinction per- 
centages of reinforcement 
0%, 
The results indicated 
centage of CRs 
was an increasing 


25%, 50%, 75%, and 
per- 
acquisition 
centage ot reinforcement 


greatest response strength for 


highest percentage of reward. Dur- 
ing extinction there was a rapid de- 
crease in response strength for the 
100% group, and less rapid for the 
others. The greatest resistance to ex 
tinction was for the 50%.and 75% 
groups, falling off for both the 100% 
25% The 0% group 
no conditioning 


and groups 


showed practically 
and therefore no resistance to extine 
tion. There was, then, a “hard core 
of resistance’ to extinction in the re 
gion between, say, 40° and 80°, re- 
inforcement 

Duplicating in design the eyelid 
study discussed above, Grant, Hake, 
and Hornseth (1951) 


conditioning situation. 


used a verbal 

During ac- 
quisition, percentage of positive re 
sponses were again an _ increasing 
function of percentage of reinforce 
ment, with each group 
positive responses at about the same 


rate as it received 


emitting 


reinforcements 
the 
group gave the greatest resistance to 
extinction, yielding the hump of the 
fi-shaped function toward the lower 


S507 


In extinction, however, ; 


percentages 

Lewis and Duncan (1956b) used a 
‘“‘one-arm bandit" slot machine, mod 
ified so that payoffs could be con 
trolled. Each payoff was worth 5¢ 
to the Ss, 
were 100°, 75% 


12.5%, and 0% 


and the percentages used 


50%, 37.5%, 25% 


The total number of 
plays to quitting was found to be an 


inverse function of the percentage of 
reward with the 100% Ss quitting 
first and the 0% Ss quitting last 
There evidence for a ft- 
sh iped function 

In another experiment, with 0%, 
11%, 33°, 67%, and 100% reward, 
Lewis and Duncan (1957) asked their 
Ss to state for each trial of the 9-trial 
“expectation” 
of winning or not winning on the next 
trial. These expectancies were quan- 
tified on a scale from 1 to 6, with 1 


was no 


acquisition series their 





PARTIAL REINFORCEMENT 3 


representing a firm expectancy of not quisition series should “‘stand out” 
winning and 6 a firm expectancy. from the extinction series, and the 
winning. The results showed t less PRE should result. A discrim- 
pectancies were a regular fui n of nation process thus results in a de- 
percentage of reinforcemer bot creasing function as a result of per- 
during acquisition an ct ( ntage of reinforcement. The sec- 
ind that the expectanc' i winnil ond process 18 a learning one. Witha 
dropped off very rapidly iring ex ponse -starting close to zero re- 
tinction for the 100°, g [ h se rength, the greater the per- 
was also the group that quit fi - of reward, for equal numbers 
this case there was a slight d " é ils below some limit, the greater 
the 0° group, sugges ‘ sha I response strength Thus the 
function lea ng process produces an increas- 

Using childret pprox tel g function, and the discrimination 
tive and one-hal : d o1 ialf process should produce a trend in the 
vears of age in a partials for opposite direction. The combination 
situation with plas is reward two results in a Nn shaped 
Lewis (1952) varie 


of reward—-100%, 5 ) nt and Schipper are correct, 
Ue in a 10-trial ; ! f the point of inflection of the N would 
He found n if , to vary with the degree of 


to extinctior tween 50%) and t lhe greater the degree of 
60%, groups and bety hn rning, the more the point of inflec- 
and 0”, groups ilthoug! n att or houl move toward the low end 
two grou quit nificanth f tt rcentage scale. This is be- 
than did the ! t un ith a greater degree of learn- 
shaped function t} ‘arning process should tend 
Five studies have beer ! lered » drot . leaving only the dis- 
each of which plotted a yur rimination process in operation. 
| 


pomts aiong a 


torcement din vi in 1 bers of acquisition trials 


percenta of 1 ral percentages of reinforcement 


to be combined in the same ex- 
t to verify this conjecture 

Not only may reinforce 

be given in different percen- 

but within any percentage less 

Schipper (1952 ral Ha and » 100, the pattern may vary 
Hornseth (1951 i ), and in 50° reinforcement, for ex- 
Lewis and Dur 7 res imple, the rewards may be given 
evidence for such " randomly, irregularly but not ran- 
tion with depressi th the hi domly, or regularly And a large 
and low percentages. Because a non 1umber of regular patterns are possi- 
monotonic function usually nean ble depending on the length of the 
that at least two processes at icquisition series. A systematic ex- 
ing (srant i ip} 5 ploration of these variables is needed 
guessed as to these two prox Grant, Riopelle, and Hake (1950 
esses might be The first process, set up random (R), single alternation 
the, hypothesized, is a discrimina SA : double alternation DA and 
tive one. The higher ‘rcentage 100°% groups in an eyelid condition- 


of reinforcement, the more the a ing situation. At the end of acquisi- 
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tion the 100% and the R groups were 
about equal and superior to the DA 
and SA groups. During extinction 
the R group showed a very rapid de- 
crement in response magnitude and 
This 


reporting 


ended below the other groups 
the few 
faster extinction following partial re- 
eX- 


is one of studies 


inforcement. There is no ready 

planation for this paradox 
Longnecker, Krauskopf, and 

1952 


Bit- 
terman performed an experi- 
ment SA and R groups, 
measuring the galvanic skin response 
(GSR). They 
significant mean difference between 
R and SA at the end of acquisition, 
although the R group appears to have 
had a response. Very in- 
teresting the -toothed ac- 
quisition curve for SA 
were considerably 


comparing 


found no statistically 


stronger 
was Saw 
Re sponses 
rein- 


forced trials than nonreinforced trials 


stronger on 


During extinction the R group was 
clearly and significantly more resist- 
ant to extinction than the SA group. 
elev ited 


Using a combinatior run- 


way and a jumping platform with 
rats as Ss, Tyler, Wortz, and 
man (1953) explored further the dif- 
ind R. Again, 
there were no differences at the end 
the SA 
group was significantly less resistant 
to extinction than the R. Also, the 


sitter- 
ferences between SA 


of acquisition, and again 


saw-toothed 
peared for SA, developing about the 
60th trial 
after a nonreinforced trial 


icquisition Ttunction ap 
Faster runs were recorded 
Earlier 
in acquisition just the opposite was 
true; taster 
warded trials. 
effect is thus discernable in 


not only in terms of 


runs occurred after re- 
A definite patterning 
these two 
studies, resis- 
tance to extinction, but also in terms 
of the acquisition function 

Hake and Grant (1951) and Hake, 
Grant, and Hornseth (1951 
concerned with the patterning effects 


of blocks of 


were 


reinforced and unrein- 


forced trials. They varied factorially 
both the blocks 


therefore transitions 


number of (and 
the number of 
nonreinforced to reinforced 
the 


This procedure resulted in 


trom 


trials) and number of trials in 
blocks 
since as the 


combining variables, 


number of transitions increased and 


as the number of nonreintforced re- 
sponses per block increased, the total 
trials also 
the 
an eyelid con 
No 
This 


the combination 


number of nonreinforced 


one ot studies 


1951 


Was 


increased In 
Hake & Grant, 
used 


ditioning situation 


rnificant results were found 
because of 

mentioned above, or it 
ay be that when working with com 


and 


TY 
iT 


I ) 


reinforced trials, 


) 
] 


ete blocks of reinforced non 


a longer acquisition 
series 18 necessary. The acquisition 
and 5 


In a second experiment 


series used here was only 1, 3, 


transitions 
of identical design (Hake, Grant, & 
Hornseth, 1951) but 


conditioni y Situation, 


with a verbal 
both the num 


ber of transitions and the number of 


reinforced trials were significant vari 


ables Three transitions resulted in 


yreater resistance to extinction than 


1 or 5, and the tewer the num 


ber of nonreinforced trials the greater 


either 

the resistance to extinction. 
Working with a modification of the 
Humphreys’ board, Grosslight, Hall, 
Murnin (1953 
in three 
RR 


a set ond 


and gave reinforce 


different patterns 
was reinforced on 
(RU) 
nents in a block always fol- 
a single block of nonrein- 
and the third (UR) had 
all the nonreinforced trials occurring 


received 


lowed by 


forced tri ils. 


as a block in the middle of a sequence 
After 
quisition sessions of this kind, an ex- 


of reinforced trials five a 


tinction session was given, and the 
responses deter 


The UR 


to extinc- 


number of “plus ‘ 


mined for the three groups 
resistant 


group was more 
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tion than the other two, and th vith at least one reinforced trial are 
group was more resistar xti superior to continuous reinforcement 
tion than RR \ up seems and to those blocks which end in a 
whose acquisitior ds with nonreinforced trial (Grosslight & 
reinforcement 1s 0 ’ ti Ra vy, 1957; Hake, Grant, & Horn- 
tinction than a who h, 1951 Little more is known 
tion series n th rei ibout patterning because even the 
forcement ilar find more obvious variables and their 
ported by Ishihara . ymbinations have not been studied 
Grosslight and Kadlow 55) ob Secondary reinforcement In the 
tained similar results with a resy ollowing discussion, S® will repre- 
reversal situat r ts sent a neutral stimulus serving as a 
Response rever wa icantly discriminative stimulus which is pre- 
slower in the UR cond han in nted before the response. And S' 
the RR and RU cond r th will represent the stimulus used as a 
idy, however, t vas no dil mdary reinforcer.’ S‘ is presented 
betwee ifter the response whose strength it 

hoped to strengthen or maintain. 

uN reinforcement (S®) is or- 

ecessary to make a stimulus 

S* or S', and S® may be pre- 

ccording to many different 

ly. he There are thus three 

between s ons, tl : rouj ) variables, the S*, the S', and the S®, 
has a reward clk fi which may be manipulated somewhat 
reintorcet | not idependently, and as a result there 
losely rth ycditi kor t 1 number of different ways in 
secondary reinforcement may 


, 195 with rats at ti ve bined with partial reinforce- 
il 


proble: mily « non ! Because each of these ways 
ed trial a session for th ring about different results, the 
used in tl ’ nd roblem of the relationship of sec- 
\vgau he wa wnt mdary reintorcement to partial rein- 
slower ver ind there forcement fractionates into the num- 
of experimental designs by which 
the three may be combined. 

terval betwee lly Three principal experimental de- 
Lewis & Duncar 56b), study signs may be used during acquisition 
shows that 1 ilar iriatio to vary the percentage of presenta- 
patterns withi t tage « ym of S® and S*. Design A-1: Pri- 
reinforcement ; ts in nm mary reinforcement is given only 
ference < | t of the time and S* is presented 
It ms r. rev on every occasion. Design A-2 
studies on patterni i] Whenever S® is given, S® is also pre- 
in less resistance n than sented, but when S® is not given, 
does R (Longnecker, Krauskoy neither is S®. Design A-3: Primary re- 
Bitterman, 1952 vie rtz, inforcement is presented on a certain 
Bitterman 1953 
sition is implied on the issue of 
clear that ! whether a stimulus must first serve as an S” 

trials which en ) im rd o serve as an S’, 
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TABLE 1 


Experimental Reinforcer 


Design SF S. 
continuous 
partial, contingent 
on S® 
partial, not con- 
tingent on S® 


A-1 partial 
A-2 partial 


A-3 partial 


percentage of trials and so is S®*, but 
the two percentages are varied in- 
dependently so that S® may coincide 
with S* and it may not. These de- 
signs are represented in Table 1. 
Because the effects of “partial sec- 
ondary reinforcement’ can only be 
determined when compared to ‘‘con- 
tinuous reinforcement,” 
only those studies in which such a 
comparison is made will be cited in 
this section. 

In addition to these general meth- 
ods of combining primary and secon- 
dary reinforcement are two general 
methods of presenting S' during ex- 
tinction, or during the test 
The S’ may be presented on every 
trial— Design E-1—or only on part 
of the trials E-2 The 
studies available in this area will be 
classified the 
used. 

There seems to be only one study 
in which Design A-1 has been used. 
Peterson (1956 
acquisition, and a buzzer was pre- 
sented on every trial just as the S en- 
tered a delay (Peterson 
was also interested in delay of rein- 
forcement.) Tests for the effective- 
ness of S’ were given in a bar pressing 
device in which S had had no pre- 
vious experience. Perhaps this proce- 
dure does not fit the usual paradigm 
for extinction, but as a test for the 
effectiveness of a secondary rein 
forcer it is certainly superior to or- 
dinary extinction 


secondary 


trials. 


Design 


according to design 


used a runway for 


chamber. 


Peterson found no 


difference between an S' associated 
with 50° reinforcement and 
associated with 100° reinforcement. 
There is also no evidence that any 
secondary reinforcement effects oc- 
curred with either percentage. 
Notterman (1951) varied the num- 
ber of nonreinforced trials in a run- 
with the number of reinforced 
trials held constant. He presented a 
lizht as S*" on each reinforced trial 
just 
nonreinforced trials S*® was not 


one 


way 


as S entered the goal box. On 
pre- 
De- 
Certain of his groups were 


sented Thus Notterman used 


sign A-2 
then extinguished to the same level 
(although Notterman’'s argument for 
this is not as firm as would be desir- 
in the absence of S' Then S‘ 
further 
reward was given 


able 


was reintroduced for trials 
but 


Response strength increased as a di- 


no primary 


rect function of the number of orig- 
inally nonreinforced 


trials 


interspersed 
The smaller the percentage of 
reinforcement, the greater the effec- 
tiveness of the S'. The smallest per- 


centage of reinforcement used 


33° 


was 


No study has been reported using 
Design A-3 
able to guess that if Design A-3 is 
combined with Design E-2, S' will be 


It is, however, reason- 


most efficacious in maintaining a re 
sponse or bringing one about anew 

Three designs for combining par- 
tial reinforcement with secondary re- 
intorcement have been considered 
For Design A-1, little can be said. 
(1956) found no clear evi 
reinforcement 
group 
A-2 de- 
parametric study, 
found greater effectiveness for S' with 


Peterson 
dence for secondary 
standard control 
Notterman (1951), with an 
sign 


even in a 


and a nice 
smaller percentages of reinforcement 
Design A-3 is untried. 

Successwe acquisitions and extinc- 
tion Perkins and Cacioppo (1950) 
gave animals 16 ac- 


one group of 
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quisition trials, only 8 of which were 
reinforced, followed by 
trials. Seven 
training were given. 

the 
except 


30 extinction 
this kind of 
A second group 


davs of 


received same succession of 


that all 
reinforced 


events acquisition 


trials were ihe results 


were more 


showed that the 50% Ss 


resistant to extinction throughout the 
extinction sequences, and the rate of 
extinction in ase ith successive 
extinctions 

Lauer and Estes (1955) used a 
jumping stand and gave three series 
each of 14 acquisition and 8 extinc- 
kor the 
acquisition series was with 100° re- 
the 
and the third with 100% again. The 


other group started with 50% and al 


tion trials one group first 


‘ 


inforcement, second with 50 


ternated on suc 
They that 
tions resulted in Jess extinction, 


cessive acquisitions 


found successive extine 
bott 
level 


in rate and terminal 


similar after 50‘ 
that there 


decrement on 


tion rates were 
100°, except 
greater 
tinction day followin 
forcement 

Lauer and Estes 
that 


extinctions had a gre 


out SsuCcCEeSSIVEe 


mon with 


typ. i] part 
ment in that nonreinforced trials 
tinctions follow reintorced tr 


acquisitions Razran (195 

also made this point The mai 
between the two is 
length of the 


and 


lerence 
seq ue nee ot reintorce d 


nonreinforced trials, which ace 
tually 


and extinctions iden 


makes successive a quisitions 
tical to the pat 
terning of partial reinforcement 
Pursuing this comparison of succes- 
sive acquisitions and extinctions to 
pattern ol reinforcement, Lauer and 
Carterette (1957 


cessive acquisitions only 


wave one group su 


\-A) and 
another group received successive ac 


quisitions and extinctions (A-I 
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Both groups received spaced trials. 
The A-A group was presumed to be 
inalogous to 100% reinforcement and 
the A-E group was presumed to be 
50% reinforcement. 
They found that the mean starting 
speed of the A-A group on all re- 
acquisition series was below that of 
the A-E group, even though the for- 
had had more reinforcements. 

a ver\ finding 
typical partial reinforcement 
should show that the 
reinforced trial following a nonrein- 


analogous to 


met 


interesting 
( ounterpart 


forced trial would be superior to a 
reinforced trial following another re- 
trial. Amsel (1958) pre- 
sented data to indicate that this is 
Amsel interpreted his 
indicate that nonrein- 
forcement has a frustration-drive ef- 


inforced 


what happens 


findings to 


fect which serves to energize the be- 
havior on the next trial. However, it 
is hard the frustration- 
drive could persist over the 30-min. 
intertrial interval used by Lauer and 
1957). It.is just this ef- 
fectiveness of partial reinforcement 
procedures on widely spaced trials 
that is most difficult to interpret. 
The Perkins and Cacioppo study 
1950 


to see how 


( arterett« 


decreased resistance 
to extinction with successive extinc- 
while both Lauer studies 
Lauer & Estes, 1955; Lauer & Car- 
1957 the re- 
It is interesting to note that 


showed 


tions 
terette, showed just 
verse 
other successive acquisition and ex- 
tinction (e.g., Bullock & 
Smith, 1953) report findings similar 
to Perkins and Cacioppo. The reason 
for the difference in results lies per- 
haps in the shortness of the extinc- 
tion series in the two Lauer studies, 
one case and 12 in the 
Che other studies in this area 
used a much longer extinction period. 

In any the Lauer studies 
point the way to a considerable con- 
solidation of partial reinforcement 


studies 


8 trials in 
other 


case, 
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variables, in that successive acquisi- 
tions and extinctions can be 
sidered as an aspect of the pattern 
and percentage of reinforcement. If 
any intertrial interval phenomena 
should turn out to be reliable, they 
should also show up as a function of 
the interval between 
acquisition and extinction series 
Number of trials. Only a few studies 


con- 


the successive 


have been concerned specifically with 
the relationship between partial re- 
inforcement and the number of ac- 
quisition trials. A large number of 
studies (e.g., Jenkins & Stanley, 
1950) however, have shown that ac- 
quisition responding is greater with 
100% than with partial reinforce- 
ment. A study by Weinstock (1958 
amplifies this statement so that it 
holds only for the early acquisition 
trials. Weinstock gave 109 acquisi- 
tion trials and, for the later trials, the 


smaller percentage groups were per- 
forming better than the larger per- 


centage groups, although there was 
no regular order. During acquisition, 
then, there is an interaction between 
percentage ol 
number of trials 

Weinstock reports the usual PRE 
with relatively clear evidence that 
rate of decrement for the per- 
centage groups is less than that for 
the high percentage groups. In addi- 
tion, the higher percentage groups 
achieve a_ different 
asymptote than the lower percentage 
groups. Finally, Weinstock notes a 
significant i 
late in extinction 
group. We are faced 
anomalous least 
for continuously groups. 
rewards depress response strength 
late in acquisition and nonrewards 
increase response strength late in ex- 
tinction. 

Lewis and Duncan (1956a, 1958a) 
in two studies combined different 


reinforcement and 


low 


and lower 


increase in periormance 
for the 100% 
here with 
that, at 


rewarded 


the 
situation 


J. LEWIS 


numbers of acquisition trials with dif- 
ferent percentages of reinforcement. 
They found no interaction during ex- 
tinction for the two variables, but the 
larger number of acquisition trials, 
in both cases, resulted in quicker ex 
Capaldi (1957, 1958) in two 


studies reports a very similar finding; 


tinction. 


the more acquisition trials, the faster 


the extinction. In his second study, 


Capaldi combined length of acquisi- 


tion with pattern of reinforcement 


some 


Ss received rewards on every 


other trial, and some received re- 


Ihe alternately re- 
group 
tinguished faster than the alternately 
si ort 


wards randomly 


warded, long acquisition ex- 


rewarded, acquisition group, 
than either the short or 
randomly groups 
difference between the 


and faster 


long rewarded 


T here 


irregular 


was no 
ly rewarded groups asa func- 
tion of the length of acquisition 

The (1956a. 
1958a 


Lewis and Duncan 
and Capaldi (1958) 
one point. Capaldi found 


studies 
difter or 


decreased resistance to extinction 


after a long acquis: tion series only for 


regular reinforcement Lewis and 


Du ical 
tio 
‘T hey 


respo! 


however, found no excep 


irregular reinforcement 
ited th it lor 


the 


a well learned 
function of acquisition 


trials far as resistance to extinc- 


tion is concerned, is to establish a 

the more ac- 
the pat- 
extinction begins, the 


This 


with regular and ir- 


stable stimulus pattern 


trials 


quisition the stabler 


tern, and whet 
stimulus change will be greater. 
should be true 
regular reinforcement, although more 
acquisition tri ils would probably be 
with the latter. Capaldi 
may not have given a sufficient num- 
ber of 


necessary 


acquisition trials to decrease 


tor 


resistance 


warded group 


his irregularly re- 
Also, he presents no 
evidence that his groups were equal 
at the end of acquisition. ’ 


Spontoneous recovery. There is very 
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little information about spontaneous 
affected by ar variable, 
little known 
the effect of partial reintorce- 


recovery as 
and 


about 


certainly there is 
ment on spontaneous recovery Per 
kins and Cacioppo (1950 
study briefly 


W hose 
has been described 


above, commen ly, “epontane- 


was complete before 
Notter 
Bersh (1952 


hea rate by eans ol 


ous 


recovery 
reconditioning trial 


Schoentfel 


conditioned 


each 
man, ind 


electri shox k The partial group 


showed no evidence of extinction al 
though the cor 

No spontaneous 

ble for the part 
found tor the con 
Lewis (1956 
found no differentia 
reiniorcement 
covery , spont inco 
curred for both pa 
ous groups. Lauer 
found spontaneous 
ring from day to day 
reinforcement, but 1 


In ti 


sponse betwee! ( 


ict, there was ad 
50%) group, but ree 
occur within the 


Phe 


meager 


empirica 
and conflictu 
inv firm conclusion about 
ot partial reintorcemet! 
taneous recovery 
Punishment. In the 
ditioning§ situation 
getting punishment by 


] 


priate response Chus, early 


quisition, S gets punished on some of 


the trials and no others, a partial 


a 
procedure I - ape learning 
situation, S gets the punishment no 
matter what 


he does, and this is a 


continuous procedure. If, as is com 
monly conceived, shock offset is re 

inforcing, one would expect, from the 
principle 


that 


ol parti il reinforcement, 


extinction would be more pro 


longed after avoidance conditioning 
than after escape conditioning. Jones 
1953), Logan (1951), and Sheffield 
and Temmer (1950) have shown this 
to be the case. Jones (1953) has also 
shown that an “intermittent escape” 
that involves with- 
holding punishment on some trials, 


schedule, one 
results in greater resistance to extinc- 
tion than orthodox escape. Wynne 
nd Solomon (1955) have pointed 
ut, in addition, that the avoidance 
extinction situation actually involves 
further learning of the instrumental 
They argue that two re- 
are learned during the ac- 
the instru- 
ntal response and the other is a 
nditioned emotional response 
R The CER has a longer la- 

y than the instrumental re- 
and on most trials the in- 
strumental response occurs before the 
CER can begin. The S is removed 
from the conditioned stimulus before 
the CER can be evoked. On some 
trials, however, the latency of the 
instrumental response is sufficiently 
long for the CER to occur, and thus 
the instrumental response serves to 
reduce the CER, and the instru- 
response is reinforced. Be- 

cause this type of reinforcement oc- 
rs on only some of the trials, the 
nstrumental actually 
extinc- 


msition series, one is 


' 


oOnse, 


mental 
response is 


reinforced during 


partially 


tion 

Intertrial interval. Sheffield (1949) 
ported indicate that 
the PRE could be obtained if the 
icquisition interval was massed (15 
sec.) but not if it was spaced (15 
and gave an “aftereffects” 
interpretation of her results. Since 
is based on a pre- 
interaction between percen- 
tage of reinforcement and acquisition 
interval, the analysis of variance was 
the appropriate statistical technique. 
Her analysis by means of t was, how- 


re 


evidence to 


min 


her com lusion 


sumed 
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ever, suggestive of her conclusion. 

Two attempts to replicate the 
Sheffield study have been reported by 
Wilson, Weiss, and Amsel (1955). 
They tried to manipulate the 
strength of the aftereffects of re- 
warded trials by using dry food in 
one experiment and water in the 
other; Sheffield had used wet mash. 
The results obtained by Wilson, 
Weiss, and Amsel were in sharp dis- 
agreement with those of Sheffield. 
The 50% reinforcement conditions 
led to greater resistance to extinction 
independent of the acquisition in- 
terval. There was no significant in- 
terval by reinforcement interaction 
either by analysis of variance or anal- 
ysis of covariance. Lewis (1956) also 
replicated Sheffield’s experiment ex- 
cept that he used a 2 min. distrinuted 
interval. He obtained essentially the 
same results as those of Wilson, Weiss 
and Amsel. Again the PRE was ob- 
tained whether or not the acquisition 
trials were distributed or massed. 

With an eyelid conditioning ap- 
paratus, Grant, Schipper, and Ross 
(1952) used a 222 factorial de- 
sign similar to that of Shefheld except 
that the intertrial intervals were 10 
sec. or 40 sec. The extinction results 
were quite complex in that there was 
a triple interaction among the three 
variables of the experiment. The 
authors interpreted this interaction 
to mean that the superiority of the 
50% groups during extinction was in- 
creased when there was a change in 
the distribution of trials from acquisi- 
tion to extinction. 

The Sheffield design was also used 
by Grant, Hornseth, and- Hake (1950) 


in a light-guessing experiment using 
a Humphreys’ board (Humphreys, 
1939). The intertrial intervals were 5 


sec. and 45 sec. Again the PRE was 
obtained independent of the acquisi- 
tion interval. Tyler (1956) in a dis- 


crimination situation found the PRE 
after a 15 min. acquisition interval, 
and Weinstock (1954, 1958) in two 
studies found the PRE after a 24-hr. 
interval between acquisition trials. 
The only study not showing the PRE 
after spaced acquisition trials was 
that of Rubin (1953), but it is im- 
possible to separate the effects of the 
intervals from possible other effects 
such as those of secondary reinforce- 
and little be concluded 
from this study. 


ment, can 
The conclusion seems to be rather 
firm that the PRE obtains whatever 
the spacing of the acquisition trials. 
Drive 
directly 


There are only two papers 
the effects of 
different drive levels on partial rein- 
One by Lewis and Cotton 
is essentially negative. 


relevant to 


forcement 
(1957 
1, 6, of food deprivation 
with 50 and 100% reinforcement for 
each drive level, they found that the 


Using 


and 22 hr 


interaction between the two variables 
did not attain significance. 

rhe other relevant to this 
variable is that of Linton and Miller 
(1951 
rec eived 


study 


[wo groups of hungry rats 
acquisition 
100°, 


training with 
reinforcement 
Each of these two groups was sub- 


either or 50% 
divided into two groups during ex- 
tinction, one of each pair being ex- 
tinguished while satiated, the other 
the drive Al 


appropriate tor a 


under acquisition 
factorial 
the data 


The results in- 


though 
analysis of variance, 


{ tests. 


were 
analyzed by 
dicated that the group partially rein- 
forced under the 
same drive as used during acquisition 


and extinguished 


was more resistant to extinction than 
the other three, which were not dif- 
In part, the 
results were interpreted in terms of 
drive-stimulus generalization An- 
other part of the explanation had to 
do with the absence of a frustration 


ferent from each other. 
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drive for the partial-satiation group 
It was believed that the absence of 
the frustration drive for the satiation 
group prevented the PRE from ap- 
pearing 

Because a motivational interpreta- 
the PRE is 

1958 


tion of not uncommon 


(Amsel, more studies are 


needed combining drive with dif 


ferent schedules of reinforcement 
sense. all 


and 


involve 


Discrimination In one 


studies using a choice 


the 


situation 
noncorrection method 
partial reinforcement, because an in 
reinforced \s 
the number of correct trials incre 
the 
Lewis and Cotton 


correct trial is never 
ases 
st) does 


ercentage o! reintorce 
| : 


ment 1955 have 
pointed out the con ple xitvy of the 
T maze as far 


ment is concerned 


‘ ’ . 
1orce 


is partial rei 
The two irms and 
the stem of the T maze e 
different percentage of reward obtatr 


The 


of the time 


ich have a 


ing correct arm is rewarded 


100°, 


1s rewarded 0° 


Phe incorrect arm 
+, and stem is rewarded 
during 
100° 


at varying percentages, low 


the early trials and almost p as 
| 


the response is learned Discrimina 
tion situations have thus afforded a 
difficult arena for the study of partial 
But because choice 


so commonly used and 


reiniorcement 
situations are 
because parti il reinforcement is such 
studies are 
out the effect of the 


in etlective’ Vv iriable, 
needed to tease 
different percentages of reward in 
the different sections of the appara 


tus Ata 


ning speeds should be 


minimum, extinction run 
determined 
separately for the stem and two arms 
of the T maze 


sirable to duplicate in a runway the 


It might also be de- 


pattern of reinforcement usually ob- 
tained in the stem of a T 

Some information about partial re- 
inforcement is available from _ re- 
sponse reversal studies, even though 


response reversal does not qualify as 
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an orthodox extinction operation. 
Wike (1953) showed that a re- 
sponse acquired under conditions of 
partial reinforcement is more resist- 
ant to reversal training than a con- 
tinuously reinforced response. This 
finding has been confirmed by Gross- 
light and Radlow (1955), Grosslight, 
Hall, and Scott (1954), and Kendler 
and Lockman (1958), but not by 
Buss (1952 
Babb (1956) 
irrelevant 


that an 
stimulus associated with 
70% of the time facilitates 
later performance when the irrelevant 
becomes relevant. When 
the irrelevant stimulus is associated 
with reward 50% of the time, it has 
no effect on later learning. When 
associated with reward 30% of the 
time, later learning is inhibited by 
this previously irrelevant stimulus. 
In general, partial reinforcement 
retards later response reversal. 
Generalization and complex stimuli. 
In a study investigating the gradient 
of primary stimulus generalization to 
tones, Wickens, Schroder, and Snide 
1954 


has shown 
reward 


stimulus 


established conditioned gal- 


vanic reactions to one of three tones 


each of which was separated by 25 


jnd's. For one group, in addition to 
the tones, a click was randomly pre- 
sented 12 times without 


ment 


reinforce- 


test 
generalization 


During trials a gradient of 
was found for the 
group without clicks, but no gradient 
was discovered in the group with 
clicks The failure to obtain a 
gradient for the click group seemed 
attributable to a generally high re- 
sistance to extinction. 

Other evidence is available (Brown 
1947) to indicate that the generaliza- 
tion gradient is very broad on the 
first test trials, becoming sharper 
with further test trials. Because the 
test trials are usually nonreinforced, 


Lest 
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generalization, and of course dis- 
crimination, is at least a by-product 
of extinction. A variable which in- 
creases 
should, then, decrease any generaliza- 
tion gradient. From this, one would 
conclude that partial reinforcement 
should increase the amount of gen 
eralization, which is indicated by t! 
Wickens, Schroder, and Snide (1954 
study. 
portant problem is needed from other 
experimental situations 

The experimenters later reasoned 
that “if a complex stimulus is pre- 
sented along with reinforcemént and 
an element of the complex is pre- 
sented at other without 
reinforcement, then this latter 


resistance to extinction 


Further evidence on this im- 


some time 
ction 
increases the resistance to extinction 
of the complex stimulus itself" 
(Wickens & Snide, 1955, . con 

An experiment (Wickens & Snide, 
1955) was undertaken to test 
hypothesis directly The 
procedure consisted of employing 
the CS a light anda 
on simultaneously 


this 
general 
as 


which came 


me 


te 
T 
s 


wo groups were 
conditioned and extinguished to this 
For the 
mental group one or the other aspect 


stimulus complex experi- 


(the light alone or tone alone) of the 
total complex was occasionally pre- 
without 
to the 


sented during the tr 
reinforcement. According 
hypothesis, the experimental 
should show greater resistance to ex- 
tinction than the This 
hypothesis w supported the 
data. 

Magnitude of reward. Lewis and 
Duncan (1956b different 
magnitudes of reward with partial re- 
inforcement using a slot 
machine. Their 10, 
25, and 50 cents for each rewarded 


group 


control 


by 


as 


combined 


modified 

rewards were i. 
acquisition play There was no 
significant interaction 
amount of reward and the five dif- 


between 


J 
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; of reward used in 
Hulse (1958), 


eng losed 


ferent percentage 
this 


ever, 


situation how- 


in alley and 
of gm and 1.0 gm 
da larger PRE with the 
larger sized pellet. The two experi- 
that it 
the crucial 

nowever, 
which 


with 
magnitudes Os 
pellets, foul 
ments differ so greatly is al- 
fut 
difference 


to it 


One possibility 


1 
most ie guess 


lies in the intertrial interval 
nportant for reward- 
Hulse used 
land Lewis and Dun- 
trial 
he 


situation like 


Hulse be heves it 
percentage interactions 
a 24-hr. interva 
n used a m 
Also, there mat 
between a pe 
Duncan's and essentially 


Lewis and 
one like Hulse’s 


In addition to magni- 


ca issed situation 


iwain a difference 


riormance 


a learning 

Confinement 
tude Hulse also varied the length of 
He found 


was less if there was a 


the goal box confinement 
that the PRI 
change in confinement from acquisi 
Different extinc- 
had effect, 
i previous studs by 
(1956 Acquisi 
eftlective 


tion to extinctio 


tion confinements 


no 
confirn y 
Hulse 1 Stanle 
tion confinements 
by the 

Variah lelay of reward. ( 
Brown, and Bitterman (1951 
of the theoretical notions 
1949 


gy variable 


were not 

; either 

rum, 
in 

testing one 

of Shetheld 


and int 


introduced a new 
into the 
bor 


given 


erestil 
forcement literature 


of Ss, 


immediately 


il reil 


' rti 
MAT Ul 
pa 


one group reward was 


kor a second 


immediately 


group, 


reward was given on 
half of the trials and it was delaved 
the half. The 


reward was delayed 


for 30 other 


se" on 


trials on which 
were irregularly interspersed among 
tl Phe 


thet found the typical 
for the variable delayed group. 


the o 
PRI 
Confirmation w 
able by Scott and Wike (1956 
Logan, Beier, and Kincaid (1956 
showed that the PRE occurred when 
delays were variably 0 and 30 sec 


is made avail- 


soon 





PARTIAL REINFORCEMENT 13 


but not when the were 0 and ist resistant to extinction was the 
Kintsch and Wike (1957) u no delay group. 

maze and gave one group n conclusion, it seems that partial 
reward on the correct trials, another lelays of 30 sec. result in increased 
group 10-se n half o 1e ince to extinction, but partial 


correct trials, a hi roup 3 lel of 10 sec. or less do not. The 


must occur on more than 25% 


The s wet tiall he trials, and when partial rein- 


nt is combined with partial 
neaid nd x p del istance to extinction is the 
peared with 30 , ° 
but not with 10 second ‘ tuation Having established an 
however, had fou increased resist pirical phenomenon in one experi- 
situation we take some prac- 
d sometimes theoretical, in- 
determining the variety of 
sin which the phenomenon 
this section an attempt will 
to review quickly some of 
rent experimental situations 
l which the PRE has been explored. 
iS’ 


ved on wis (1952) used children in a 


were 30 second other t S itton pushing situation The re- 


Se received is were plastx cowboys and, in 


The 25°% group extinguis!l faster )-trial acquisition series, were 
than the other tv icl re! ' 100°, 60°, 50%, and 0% of 
significantly d pparent h e. There was no difference in 
reward mus lelayed on more tl 4 en the 50° and 60% 
r between the 100°, and 
but the former two 
superior to the latter 
Mech, and Auble (1955 
lar situation measured the 
i responses to extinction 
imo rest! ment é fter 100%, 50%, and 25% rein- 
group was orced o1 . tr forcement. The 25% group was con- 
with no delay nother also id siderably the most resistant to ex- 
100%, ! met hd i ( netion, followed by the 50% and 
13 groups in that order Fattu, 
nd Mech (1955) were not 
~peat their results although 

trend was apparent. 
nd Rabaiola (1952) had Ss 
one of three nonsense syllables 
color stimulus. The correct re- 
nse was reinforced with a buzzer 
group with delay and » grout 100%, 75%, and 50% of the time 
without delay were about eq for the different groups. The speed 
next most resistant *xtil I ) iinment of a criterion of learn- 
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ing Was an increasing function of the 
percentage of reward. After the cri- 
terion was reached the reward condi- 
tions were switched. Half of each 
acquisition group was given 0% re- 
ward, and the reward percentage was 
halved for the other. The mean 
number of correct responses de- 
creased faster for the 50°, and 0% 
group than for the 100% to 0° 
group. This runs counter to the usual 
PRE. 


port an increase in correct responses 


t 
Also, Goss and Rabaiola re- 


after about eight trials of no reward. 

Hirsch (1957 his Ss 
with a series of words to which they 
The 
correct number was one less than the 
number of letters in the words. He 
reinforced his Ss either 100%, or 67% 


presented 


were to respond with a number 


of the time for the correct responses. 
All reinforcement was omitted after 
Again there 
Perhaps, if 


a criterion was attained 
was no significant PRE 
more of a “persistence” imeasure of 
extinction had been used in these two 
studies, the typical PRE would have 
occurred. 

Kanfer (1954 
Papajohn (1957) 
of reinforcement in an 
situation. A restricted 
verbal statements about movement 
was selected for reinforcement. Kan- 
fer rewarded these responses at 100% 
67%, 50%, and 0% for 


Spivok 


percentage 


and and 
V aried 
autokinetic 


class otf Ss 


different 


groups, bringing all but the 0% group 
to the same criterion of performance. 


The reward removed The 
typical PRE was found in that the 
greater 
sponses 
group. 
inforcement 
condition for the PRE. Kanfer 
pointed out that the rate of extinc- 
tion may be as important as the total 
number of responses emitted. Spivok 
and Papajohn (1957) compared 100% 


was 


“critical” re- 
the partial 
The S's awareness of the re- 


number of 
was found in 


was not an essential 


ilso 
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reinforcement with a variable inter- 
val schedule, finding greater PRE for 
the latter. 

Finally, Lewis and Cotton (1958) 
found the PRE in a T maze with a 
correct turn response measure. Their 
had partial reinforcement 
administered by being placed in the 


animals 


goal by hand with food present on 
50% of the placements. However, 
both the 50% and 100% groups were 
worse than a control group that did 
not reinforce 


receive nonresponse 


ment 
THEORY 


In 1950, 
theories of 


the various 
reinforcement, 
(1950) ennu- 
different 
response 


discussing 
partial 
Jenkins and Stanley 
merated five essentially 
(a) 
aftereffects, (c) discrimina- 
reinforcement, 


All of 


remain today as viable entries in the 


theories. These were: 
unit, (6 
tion, (d) secondary 


and (e) expectancy. these 
parti il reinforcement sweepstakes al- 
though the response-unit hypothesis 
is rarely used for discrete trial phe- 
nomena, and the expectancy hypo- 
much battered of 
late and seems to have no articulate 
supporter remaining In addition, 
two new entries since 1950 


thesis has been 


there are 
These are: (a) a competing response 
theory of Weinstock (1954), and one 
by Hulse Stanley (1956), and 
b) a mediating response theory, es- 
Amsel (1958), Kendler, 
and D'Amato (1957) and 
Beier, and Kincaid (1956) 
among others 


A ftereffects 


and 


poused by 
Pliskoff, 
Logan, 
One of the first. and 
probably still as good as any, state- 
ments of the aftereffects theory is that 
of Sheffield (1949). 
that the aftereffects of reinforcement 
different the after- 
nonreinforcement. When 
reinforcement occurs, S would have a 


She pointed out 


are quite from 


effects of 
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food taste in the mouth, perhaps food 
particles, and still other stimuli asso- 
ciated with eating. After a nonrein- 
forced trial the aftereffects would in 
clude frustration, searching, etc. Ob 
viously the stimuli following nonrein 
forcement would be ‘very different 
from those following reinforcement 
If the stimulus aftereffects of non 
reinforcement are still present on the 
next trial, and the next trial results 
in reimlorcement, the 


then instru 


mental running response would be 
conditioned to the aftereffects of non 
reinforcement, and the S would ac- 
tually learn to respond to the stimuli 
of nonreintorcement Since the ex- 
tinction stimuli are those of nonrein 
forcement, S has learned to respond 
during extinction. Those Ss who are 


rewarded on every trial never hav 


the opportunity 


to respond to non 


reinforcement cues and thus have 
not learned to respo! d to extinctio 
stimuli 

But this is only the learning factor 
of the aftereffects theory as Shefheld 
[here is also 
generalization factor For 
tinuously reinforced Ss, the 


introduces new stimuli 


describes it. 1 primary 


the con 
advent 
ol extinction 
for the 


first time, those 


With the 
stimuli there 
response decrement due to 
generalization 


reinforced Ss 


irom non 
reinitorcement 


trodus 


tion of new will be a 
primary 
For the 


would 


stimulus 
partially there 


be no new stimuli introduced with 


extinction, since nonreinforcement 
had occurred repeatedly during the 
acquisition, 

lo demonstrate the adequat y ol 
her reasoning, Shefheld ran 50°, and 
100% combined 
with massed and distributed acquisi 
With 
afterefiects of 


should still be present at 


groups, factorially 


tion trials 


massed trials the 
nonreintorced 
the i 


tion of the succeeding trial, as 


trials 
itia 


the 


theory With distributed 
trials this would not be the case. Her 
results probably confirmed her theory 
for the PRE seemed to appear, as 
tested by ¢, only after massed trials 
50% reinforcement. 

Following implications of 
Sheffield’s hypothesis, Grosslight and 
Radlow (1955) and Grosslight, Hall, 
and Murnin (1953) found that sev- 


requires. 


and 


some 


eral series of trials in which a single 
nonreinforcement is followed by rein- 
forcement would result in the PRE, if 
the nonreinforcement were followed 


The authors in- 
results in terms of a 
theory, in 
the aftereffects of the nonrein- 


DY a reiniorcement. 
terpret their 
Shetheldian 
that 


altereftects 


forced trials are presumed to be con- 
ditioned to the instrumental response 
because they are followed by a rein- 
but it should be 


discrimination 


noted 
hypothests 


lorcement, 
that a 
would handle the results equally well. 

Linton and Miller (1951) found no 
PRI 
reinforcement under normal depriva- 


; 


when extinction, after partial 


ion conditions, was carried out under 
conditions of drive 
with the reward 

tf il Lhey 


and 
each 


satiation 
present on 
reasoned that this was 
there very different 
iftereffects occurring during satiated 
“extinction” and that the instru- 
mental response had not been con- 


because were 


ditioned during acquisition to these 
alteretiects 
As noted in 
trial 
Amsel 


study 


the section on inter- 

Wilson, Weiss, and 

repeated Shetheld’s 
with minor variations 
and without her results. In one case 
the variation was such as to enhance 
the the other, the 
variation served to reduce the after- 
effects, but in neither case was the 
acquisition-partially 


interval, 
1955) 


twice, 


alteretiects. In 


massed rein- 
forced group more resistant to extinc- 


tion Lewis (1956) also repeated 
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Sheffield’s study using a 2-min., in- 
stead of a 15-min. spaced interval. 
The graph of his results appeared to 
be Sheffieldian, but the appropriate 
statistical analysis showed no signifi- 
cant effect. 

Continuing the attack on the after- 
effects hypotheses Tyler (1956) found 
the PRE in a discrimination situa- 
tion even after a 15-min. acquisition 
interval and, even more devastating, 
Weinstock, on two occasions (1954, 
1958) has found the PRE even when 
acquisition trials spaced 24 
hours apart. This suggests that long 
range aftereffects are more important 
than previously believed 

Tyler, Wortz, and_ Bitterman 
(1953) reasoned that if Sheffield were 
right, a simple pattern 
reinforcement with 
ment—should give a 
than a random pattern, because al- 
ternation maximizes the number of 
times nonreinforcement follows rein- 


were 


alternating 
nonreintorce- 


PRE 


greater 


forcement. Their results showed just 
the opposite; alternation resulted in 
quicker extinction than did the ran- 
dom pattern. 

Another ingenious attack on the 


aftereffects theory was performed by 
Crum, Brown, and Bitterman (1951). 
If the reward were delayed after each 
trial, they argued, the aftereffects for 
the succeeding trial would always be 
those of reinforcement 


They com- 
pared a group which received delay of 
reward on some of its trials and im- 
mediate reward on 
group that 
ward on all trials. The partial delay 
group showed the PRE very nicely 
Peterson (1956), Logan, Beier, and 
Kincaid (1956), Wike (1953), 
have confirmed the results of Crum, 
Brown, and Bitterman. 

Feher (1956) performed some in- 
teresting variations on the delay of 
reward. 


othe rs with a 


received immediate re- 


and 


She compared delays given 


before the reward with delays given 
after the reward. For the latter, Ss 
were simply left in the goal box for a 
She found 
that both delay groups extinguished 
slower than without delay 
And the deiay-before-r urd group 
extinguished slower than the delay- 


specified period of time. 


Kroups 


after-reward group, again counter to 
an altereffects notion 

Katz (1957) ran three groups of 
animals in a test of the aftereffects 
notion. The acquisition trials were 
given in two quite different runways 
One trial was given on the first run- 
way, followed immediately by a trial 
One group 
partial reinforce- 


on the second 
(P-( 
ment on 


runway 
was given 


the first runway and con- 
tinuous reinforcement on the second 
A second group (C—P) was given just 
the reverse: continuous reinforcement 
on the first and partial on the second 
rhe final group (C-C) was given con- 
reinforcement on both run- 


For the P-( 


reinforced trials occurring in the first 


tinuous 
ways group, all non- 
reinforced 

For the 
C-P group there was no similar op- 


runway were followed by 


trials in the second runway 
portunity for conditioning the after- 
All ex- 


tinction trials were given in the sec- 


effects of nonreintorcement. 
Che results showed that 
the C-P was slowest 
followed by the P-C group, and the 
C.( extinguished 
pidly. 


ond runway 
to extinguish, 
group most fra- 
his would indicate that other 
atterettects are 
n bringing about the PRE 
that can be 


factors than most 
important i 

Phe only 
drawn from experiments is 
that, at best, Sheffieldian aftereffects 
are not important contributors to the 


PRE, and 


effect whatsoever 


com lusion 


these 


they have no 


probably 


Che 


which was apparently 


Discrimination discrimina- 


tion theory, 


first advanced by Mowrer and Jones 
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(1945), has had the advar 


ng less specif ally stated 


tage of be 

than the 
aftereffects theory, and the longevity 
of a theory is apparently inversely) 
related to the specificity with which 
it can be stated and tested. In general 
the discrimination theory states that 
resistance to extinction 1s a tunction 
of the 


stimuli to the extinctior 


similarity the quisition 
The 


more similar the stimulus conditions 


‘ | 
i Stimull 
are in the two situations, the greater 
extinctiol! The 
problem then becomes one of 


the resistance to 


demonstrating the variables of 
be said 


and 
which similarity may 
function. Once lawful relation 
are obtained between similarity 
ables and beh ivior, any controversy 
over whether discrim 
isa perce ptu il one 
thing going on 
superfluous. Th 
crimination theorists, 
stating specifi illy wha 
termine similarity 
Probably the 
porters ol the disct 
esis have been the 
though their research |} 
more at disproving 
than it has 


to a discriminati 


theory 


‘ 


Wortz 


showed th it 


Krauskoy 
and Tyler 
1953 


necker, 
(1952 
man 
ternating patter! 
and nonreinforcen 
extinct 

Since this 


qule ker 
pattern 
in aftereffects theory 
there must be come set 
that 


inate 


occur®rs, 
the 


re Spo! ding 


enabling 
acquisition st 
stop quickl 
ceases, 

Bitterman, Feddersor 
(1953) and Elam, Tyler 


man (1954) gave rewards in 


box and nonrewards in a very dif- 
One group was extin- 
guished with the rewarded end box 
present and another group was ex- 
with the nonrewarded 
Presumably, the stimulus situa- 


lerent one 


tinguished 
box 
tions from acquisition to extinction 
vould be more similar when the non- 
ewarded end box was present be- 
juse these stimuli had always in the 
Us- 
ng the rewarded end box during ex- 


ist accompanied nonrewards. 
tinction would bring about a stimulus 
change because these stimuli had al- 
ways accompanied rewards. The pre- 
dicted results occurred, and were in- 
terpreted according to the discrim- 
The authors tended 
to speak as if the discrimination were 


' he ‘ 
on theory. 


perceptual in some fashion, but, of 
course, all they could do was to relate 
this 
There is no need to 


behavior to stimuli, in case 
stimulus change. 
introduce an intervening perceptual 
process to handle this data. 
Monkeys were given their choice, 
Elam and Tyler (1958), between 
stimuli, A and B. For one group, 
\ stimulus was rewarded 60% 
of the time and the B stimulus was 
For the 
stimulus was 
of the time but 
the B stimulus was rewarded 0% of 
During extinction, the A 
was rewarded 0° of the 
the B. stimulus was re- 


100% of the time for both 


rewarded 40% of the time. 
second group, the A 
ilso rewarded 60% 
the time 
stimulus 
time and 
warded 


groups 


Results showed that during 


icquisition, A was much more pre- 


ferred by the second group, but dur- 
ing extinction, A extinguished much 
more rapidly for the second group. 
Elam and Tyler attribute the much 
faster extinction of A for the second 
group to the greater stimulus change 
from extinction oc- 
curring for this group than the other. 


and Pettigrew (1956) 


acquisition to 


(,06 »>d now 
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presented a somewhat similar prob- 
lem to four groups of human Ss. The 
apparatus was a “two-armed bandit” 
One group received reward for a LR 
(left-right) pattern of responses, the 
second received reward for an LL pat- 
tern, a third was given an LLR pat- 
tern, and the fourth was given a ran- 
dom pattern. After an acquisition 
series of trials, all groups were given a 
random pattern for a while and then 
all groups were switched to a final 
LR pattern. Both the initial LR and 
LL groups learned the final pattern 
faster than the random _ group. 
(Many of the LLR group did not 
learn the initial pattern.) Goodnow 
and Pettigrew concluded that the 
final pattern was made dis- 
criminable because of the stability of 
the initial response pattern. Also, 
there was less of a stimulus change 
for the two initially systematic 
groups than for the initially random 
group. 

McClelland and McGown (1953) 
gave one group of animals irregular 
reinforcement in various parts of a 
circular shaped apparatus. Another 
group always found the reinforce- 
ment in the same place. Results 
showed that the inconsistently re- 
warded group was more resistant to 
extinction. The authors concluded: 
“Omission of reinforcement changes 
the cue pattern less if the original 
cue pattern is complex or variable, 
than if it is simple and invariant."’ 

Sheffield and Temmer (1950) have 
shown that the superior resistance to 
extinction of avoidance learning to 
escape learning can be given a partial 
reinforcement interpretation. 
(1953) found that an “intermittent 
escape”’’ group, one that was not 
punished on every trial but still could 
not learn to avoid, was more resistant 
to extinction than an orthodox escape 
group. Also a “‘limited 


more 


Jones 


avoidance’ 


group extinguished slower than the 
“Limited avoidance” 
referred to a condition in which the 
S was placed on an initially un- 
charged grid, but the current would 
be turned on before S could get off 
the grid. The faster S moved the less 
shock he would take, and in this 
sense it was an avoidance condition, 
but even so, S would always get the 
punishment. The “‘limited 
ance’ group was also more resistant 
to extinction than the pure 
group. The acquisition conditions, 
according to Jones, were more like 
the extinction conditions for the ‘‘in- 
termittent escape’ 


escape group. 


avoid- 


escape 


ind the “limited 
conditions than they 
were for the escape conditions. 


avoidance” 


In several studies Lewis and Dun- 
can (1956a, 1956b, 1957, 1958a, 
1958b) that 0% reinforce- 
ment showed more resistance to ex- 
tinction than 100% reinforcement, 
and more than most other percent- 


found 


Their situa- 
‘one-armed bandit,"’ differed 
from most others in that no learning 
was involved in the performance of 
All Ss, on 
coming into the experimental room, 
already knew how to pull a lever. 


ages of reiniorcement 


tion, a 


the lever pulling response. 


The experimenters argued, therefore, 
that the 
primarily 


served 
to set the extinction series 


acquisition series 
apart, and that 0% acquisition was 
In one 
of these studies (1958a) they found, 
contrary to 


most like the extinction series 
most previous results, 
that extinction was quicker after a 
long acquisition series. Again they 
attributed this to the pure perform- 
a relatively 
long acquisition series would serve to 
make the initial 
more stable. 

Somewhat 
reported by 


ance situation in which 


stimulus situation 


have 
(1957, 


results 
Capaldi 


similar 
been 
1958) 
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Brand, Woods, and Sakoda (1957 
in a two alternative situation varied 
both the difference in percentage of 
reinforcement the difference in 
the ratio of reinforcement. The dif- 
ference, for example, between 57% 
the 
three to one. The difference between 
100% and 50% is also 50°, but now 


und 


and 25% is 50%, and ratio is 


found 
that extinction is quicker when the 


the ratio is two to one They 
percentage difference is great (a find 
discrimination 


the ratios had 


with a 
but that 
practically no effect 
Fehrer (1956 
lay of 
creased resistance 


ing in a line 


hypothesis 


, who found that de 
reinforcement leads to in 
to extinction, also 
interprets her study according to a 
discrimination theory in that having 
a delay come before a reward affords 
that of no reward 
much like the initial experi 
ing extinction 

All of the studies that 


reviewed in this section so far present 


an experience 


ce dur- 
have been 


evidence that has been interpreted as 


favorable to discrimination theory 


studies, how- 


leral 


There are two 
that 
hurdle for discrimination 
jump. Marx (1958 


of animals acquisition training in a 


recen 


ever, present i consK le 
theory to 
gave two groups 
runway with food pellets presented 
During 
extinction one group was presented 


in the end box in a glass cup 
with the empty cup on every trial, 
and one group was presented with the 
empty cup on only half of the trials; 
on the other half the food cup was 
absent. There was a greater stimulus 
change for the group that had the 
cup on only half of the trials, yet this 
group extinguished slowest. In a 
more elaborate experiment, Brown 
and Bass (1958) varied the stimulus 
conditions 


different alleys—in both 


acquisition and extinction Phey 


found that variable extinction condl- 


tions resulted in increased resistance 
to extinction. In both of these experi- 
ments, stimulus change increased re- 
sistance to extinction instead of de- 
creasing it as the discrimination hy- 
pothesis would seem to demand, but, 
it should be noted, only 100% rein- 
forcement was used in both studies. 

In addition, Brown and Bass found 
that irregular stimulus conditions 
during acquisition had no effect on 
resistance to extinction. This seems 
to run counter to previous evidence 
MacKintosh, 1955), but Brown and 
Bass have the better designed study 
in that theirs was a factorial com- 
bination of variables in both acquisi- 
extinction. MacKintosh 
extinguished all Ss under constant 
making it impossible, as 
Brown and Bass point out, to dis- 


tion and 


conditions 


tinguish between learning condition 
irregularities and the change from ir- 
regular acquisition to constant ex- 
Both the Brown and Bass 
ind the Marx study are consistent 
with much previous evidence (e.g., 
Glazer, 1958) indicating that stimu- 
lus novelty and change increases per- 
form It seems, then, that one 
at least conclude that stimulus 
during extinction must be 
weighed more heavily in increasing 
resistance to than 
stimulus conditions from 
extinction. In any 
case, the studies of Brown and Bass, 
1958) and Marx (1958) complicate 
the task of discrimination theorists. 

Secondary reinforcement. Denny 
(1946) is usually given credit for the 
formal introduction of the secondary 
reinforcement hypothesis into the 
area of partial reinforcement. He 
pointed out that on reinforcement 
trials the stimuli of the goal box are 
with primary reinforce- 
ment and therefore should acquire 
secondary reinforcing power. On 


tinction 


ince 
must 
change 
extinction con- 
stancy of! 


acquisition to 


associated 
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nonreinforced trials and during ex- 
tinction, reinforcement 
should be taking place which would 
retard 
The attack on the secondary rein- 
forcement with 
Bitterman, Feddersen, and Tyler 
(1953) and Elam, Tyler, and Bitter- 
man (1954 Chey found that 
extinguished in the goal box in which 
they had received their 
trials—the nonreinforced trials were 
given in a very different goal box 
showed less PRE than 
guished in the goal box was 
present for nonreinforced trials. Ac- 
cording to a Hullian (1943) secondary 


secondary 
extinction 


hy pe thesis beg in 


rats 


reintore ed 


those extin- 


Ww hic h 


reinforcement hypothesis, the results 
should have been just the opposite 
The stimuli associated with primary 
reward and present during extinction 
should have 
performance 
ent situations Notterman 
Freides (1957 have 
significant aspects of these studies 
They found no differen e between the 
but this 


Sse ond iry 


prolonged extinction 
In only slightly differ- 
1951 


dupli ited the 


and 


two relevant groups, still 


does not support a rein- 
forcement interpretation 

Mason (1957) has reported an in- 
teresting experiment. His animals 


learned two discriminations. In one, 


the positive stimulus was rewarded 
100% of the time; in 
rewarded 50° of the time 


the other it was 
On the 
test trials both positive stimuli were 
presented and the S’s preference on 
successive trials constituted the re- 
sponse measure. Most Ss chose the 
stimulus that had been 
100% of the time, even when twice 
as many total trials had been given to 
the 50% rewarded stimuli, so that the 
total number of primary rewards in 
the two situations was the same, but 
the 50% group would have had sec- 
ondary reinforcement 
These results 


rew irded 


addition. 
interpreted 


in 


were as 


J 
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opposed to a sec ondary reinforcement 
hypothesis 
The 


ilso be interpreted as opposed to a 


results of Fehrer (1956) can 


reinforcement interpreta 


partial 


second iry 


tion of reinforcement Iwo 
of her 
lays (one w 


10 Sc( 


Kroups involved goal box de 
30-ser 


period 


delay 

and 
eating period 
Another 
a full 
I he goal box 


is 


yiven a 
before i eating 


one was given a 10-se¢ 


30-sec. delay 


to 


followe | by i 


group was allowed eat tor 
40-sec. in the goal box 
h id a lo 
primary reward for the latter group 


should 
than the other two 


stimill ger association with 
slower 
Just 


opposite happened; both delay 


and have resulted in 
extinctio! 
the 
groups extinguished slower than the 
nondelay group 

Hulse nd Stanley 
but ilv at 
nee, that 


when 


(1956 re 


10 level of 
PRE occurred 


ported, the 
the 
~ 
tricl 


at this point, seems 


only the was present on 


every 
The evidence, 


training 
quite conclusive that secondary rein 
forcement is not the sole explanation 
of the PRE, but that 
illy eff ious was indicated 


1957 


it can be ex 
ceptior Wat 


lree res 


Ww ho used a 
He 


is irregularly 


in 
Situation 

n So 
reiniorcement, it 

Ss 


Suy 
gested 

AaSSOCIA 
and 


loses function 


maint inction over a con 


It 


pre sented 


sidera is most effective 


S 


is 
an irregularly 
avaln 


Zimmerman’s study is based 


on very few animals, and needs to be 
replicated before it can be accepted 
with but it 


seems probable that a stimulus, when 


ibsolute confidenc e, 


irregularly associated with reinforce- 


ment and then used irregularly as 


an 
S', can have very powerful reinfor 
ing value. At this point, however, it 
becomes difficult to distinguish be- 
discrimination 


tween a hypothesis 
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and a secondary reinforcement 
in { a th if t he \ 
the same 


It seems likely, 
basically 

Competing re 
1954) has presented 


Weinstock 
“habitua 


theory which states essentially 


pon 
in 
tion’ 
that 


nonreinforced responses “‘ha 


emecitie 


bituate”’ by some uns4 1 process 
ind drop out 
tially 
sponses are 
the 


these competing respo es 


| or a gro ip 


ot pat 
rewarded Ss, mpeting re 
uisition 


on nonreti 


drop 
= ’ 


Thus when extinction beg 


the 
1, 


competing have alre 


habituated and 


re sponse 5 


the 


sponse < ont! 


bituation of the « rit 


occurs during 


ues 4 


cquisit 
tinuously reinforced ¢g 
onset during extinction 
rapid decrease the 
response 

iments 


The only per 
rectly at 


testing this notior 
theugh Tyler 1956) has 
out that Weinstock’s theor) 

] 


exp 


| random reit 


yreater PRE ¢t 
nating reinitorcement ul 
Stanley and Cl 

Hulse (1958). St 

assumed 
the 


uti whi 


results in a 


that if 
goal box, n 
sponses would oc: 
ite. The gave 

id a 


groups durit y at 


ment at ot 


the se two dow! 
mediate goal box 
during extu 
Sane 
delay 


resistant 


de} 1) 


be | 
icquisition group 
to extinctio!r 


roup 


more 
immediately rewarded ¢ 
results are opposed to 
habituation theory, if 
ot 
but they are also opposed to the re 
ol (1956 foun 


1 function time in the goal box 


sults Fehrer who 
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30-ser 

the 
extinction 
In another study, Hulse and Stan- 
1956 


that delays, both before and 


ifter reinforcement, retarded 


ley presented a theory some- 
to that of Weinstock 
They also argued that com- 
the 


nonreinforced acquisition trials, but 


what similar 
1954 
peting responses occur during 
for them the competing responses do 
ot “habituate.’’ The Ss learn to do 
something other than eat during 
When extinction starts, 
Ss the 

thing that they learned 
ng acquisition and are quickly 
the stimuli which 

and thus the condi- 
tioned eating response is protected 
from rapid extinction. At this point 
Hulse and Stanley follow the notion 
of Sheffield, Roby, and Campbell 
1954), that the faster extinction of 
conditioned eating leads to a faster 
of the instrumental response. 
This is because the conditioned eat- 
works backward over 
maze stimuli and constitutes an 


these trials 


the partially reinforced do 


else” 


irom 


iting, 


removed 


‘ voke c 


SS 


ng response 
the 
portant part of the stimulus situa- 
leading to the instrumental re- 

ind Stanley's theory ap- 
s to be more specific than Wein- 
stock's 
h a vague term as “habituation” 
playing an important role. Also 
Hulse and Stanley indicate how the 
goal box competing response can af- 
lect the be- 
ginning of the apparatus. But this 
, too, runs into difficulty when 
1957) data aré considered. 
He found that behavior in the goal 
box ex- 
response 


because it does not contain 


behavior occurring at 


oto! 


| re ides’ 


approaching food) could 


tinguish while a runway 


remained 
f 


strong. 

responses. It should 
be noted that the theory of Hulse and 
Stanley (1956) involved a mediating 


. ; 
Mediational 
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conditioned and 
could very properly be considered in 
this section also 

Wilson, Weiss, and Amsel (1955 
and Amsel (1958) have argued for a 
mediating frustration response as an 
explanation of the PRE 
partial reinforcement an 
response 


eating response 


During 
emotional 
develops the 
forced trials [The emotional 
sponse works backward 
maze stimuli and 
stimuli of the 
tional response has stimulus proper 


on unrein- 
re- 
the 
the 


The emo- 


overt 
1S evoked by 
start box 
ties, as do all responses, and these 
stimuli 
instrumental 
emotional 
conditioned during 
the instrumental 
100% Ss, 
sponse decrement during extinction. 
the 

Kendler, 


(1957 


the 
the 


conditioned to 
since 


become 
response 
response does not get 
acquisition to 
for the 


sh irp re- 


response 
they show a 
Essentially 
sented by 
D'Amato, and 
that no special properties, 
emotionality, are 


same idea is pre- 

Pliskoff, 
Katz except 
such as 
the 
ind Dun- 


I edi 


ascribed to 
mediating response. Lewis 
can (1958b) 


response to interpret their dat: 


also used a iting 
1 and 
show how some language behavior is 
related to it. 

Logan, Beier, and Kincaid 
maintain that 
tion is a direct function of the degree 
to which the mediating response per- 
sists beyond the time 


1956 


resistance to extinc- 


it which rein- 
forcement usually occurs 
forcement time do 
during 100% acquisition 
reinforcement is given every time as 
soon as S enters the goal box 
do, however, occur 
tion, evoking the re- 
sponse and quick extinction results. 
With longer delays of reinforcement 
during acquisition such as occur in 
a varied delay procedure, the occur- 
rence of mediating 


‘“‘Postrein- 


cues” not occur 


because 


Chey 
during extinc- 


mediating 


responses to 


J. LEWIS 


postreinforcement time cues will be 
increased because the mediating re- 
sponse is eventually reinforced after 
the delay. Thus the mediating re- 
sponse continues over a longet time 
for the partial delay 
rewarded 


Ss, and gets 
prolonged. It 
will occur over a longer period dur- 
the 


mediating response lasts longer, and 


for being 


ing extinction also Because 
is conditioned, presumably, to the 
the 
mental response will also last longer 


Beier, Kincaid (1956 


are not entirely clear on this point, 


| 
instrumental response, instru- 


Logan, and 
however 
Expectancy. Expectancy ‘‘theory”’ 
was brought into partial reinforce- 
Humphreys (1939) He 


considered that his early partial rein 


ment by 


forcement studies were contrary to a 
view, but 

handled 
expectancy. 
that partial 
resulted in an 


drive reduction point of 


could be 


com ept of 


“ 

that. the ita 

nicely by a 
, 


Basically, he argued 


reintorcement eXx- 
irregular reinforcement 


tin 


pectanc\ ol 
that cor! 


resulted in 


and uous reinforcement 
in expectancy of regular 
He further stated 
that it was easier to change from a 
lar expectancy of one kind (that 
rewards trial) to a 


kind 


any 


reintorcement 


regu 


occur on every 
another 


occur 


regular expectancy ol 
(that rewards do 
trial 


not on 
than it was to change from an 
(that 


only some of the trials) to a 


irregular expectancy rewards 
occur o1 
regular expectancy 

Lewis and Duncan (1957) at- 
tempted to test Humphreys’ notion 
by having their Ss state, before each 
trial, the confidence they held that 
they 


trial 


would win or lose on the next 
T hey found 
their data for 


no evidence in 
Humphrey's notion 
that those with irregular expectan- 


cies of 


during 


winning would continue longer 
extinction than those with 
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regular expectancies Insofar 
Humphreys meant 
kind ol 
not pertinent 
trial 


The two-light 


some 


ove! 


expectancy, these data are 
since they are trial-by 
expectancies 

Humphrey 

been a standard 


has ippar 


studying expectancies ves 


‘no’ statements—for a imber 


Years Recently several studies have 
appeared with this device which have 
used a shift in s | 

probabilities 

to the postshil 

sumably the 

shift 


lhus this situat 


probab lit 


means, al least 
ng expectancies 


195 


Parducci 7 
three 
Sc)f 

groups were 


lo ind more cot} 


y ’ 

the postshilt probability w he 
magnitude of the shi 

He interpreted hi 

ti 1 discriminat 


ter to Humphreys’ reg 
. 


cluded, although the 
very ciear on th Ss po 
pected permanence 


‘ ne +} ¢} 


| 


(,00q0c now i 
(,oodnow, 1955 


grew, 1955 (,00dno0 


1956; Goodnow & 
number of 
that 
more likely to approach 100‘ 
most probable light af 
than if it 
l “problem solving’ one ] inl 


1958 


it a 
would be 


to the 


pothesized yuesses 
the situation 
were a “chance” one 
ies al d 
Rotter 
the 


would 


alse hypothe ized that 
“skill” 


difference 


‘chance”™”’ and 
make i 


were 


nce to extinction. They gave one 
of instructions to indicate that 
the task involved chance only, and 
one set to indicate that the task was 
ymnily Instructions were com- 
bined factorially with 50 and 100% 


reiniorcement Cheir hypothesis was 


confirmed With skill instructions, 
the 100° group took longer to ex- 
With 
chance instructions, just the reverse 
true. James and Rotter inter- 
the effects of 
kind, 
Postman 
a slightly different situa- 
that 
1 necessary part of such proba- 


tinguish than the 50% group. 


was 
pret their results as 


nbolic processes of some 


(,oodnow and 


maintain “awareness” is 

ity discriminations. 

Perhaps every study cited in this 

rt could be reinterpreted ac- 
ling to an expectancy 

ind that is the main 

i point of view. 


ay of 


notion, 
weakness of 
such There seems to 
disproving it. Cer- 
t much recent research has 

iented around expectanc ies, 
ind this concept is apparently mori- 
explanation of the PRE. 


nd iS al 
( ONCLUSION 


The writer began this review of 
he literature on partial reinforce- 
ment in the hope of arriving at some 


the PRE 


is at least as far away 


ation ol Unfor- 
in itely, he 
from an explanation now as when he 
started Conflicts and contradic- 
ns in data contribute their share 
of confusion, but probably more im- 
portant has been the absence of the 
right kind of data. In the data sec- 
this attempt was 
nade to discover parametric laws. 
Except in very few 
was impossible. Not 
nenters seem to be interested in how 


tion ol paper an 
instances, this 
many experi- 


one variable relates to another along 
the both variables. 


major range of 
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Most experimenters are interested in 
“theory” testing. As a result we 
have a large nuniber of two or three 
group experiments, using a widely 
different array of apparatus, some- 
times combined in factorial designs, 
telling us that our theoretical no- 
tions are largely inadequate, but not 
telling us a great deal more. To de- 
termine a law probably 
at least five points are needed along 
each dimension. With fewer than five 
points, the task of stating the law 

describing it by an equation 
tively trivial. With more 
points, and a small number of con- 
stants, the dimension can be 
scribed with some precision, assum- 
ing the data are reliable and that a 
dimension is actually 
tainly curve fitting can be an arbi- 


parametric 


is rela- 
hive of 


de- 


present Cer- 
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trary procedure, and certainly it is 
not all there is to theory, but, also 
certainly, a theory ought to be about 
something, parametric data 
make a subject matter 
But this is just saying, in a more 
way, 


and 
wonderful 
elaborate “more research is 
needed.’ 

Che writer feels no desire at pres- 
ent to carry cudgels for any of the 
“theories” 
he have 


now available, nor does 
i theory of his own to con- 
tribute that he has any confidence in, 
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“LAND! LAND!” 


ALLS 


f California, Berkeley 


On every han rints as simply as black-and-white 
res are now made in Polaroid cameras.' 
that a new cor 
. , I applications, however, could be much 
. nm #} Im of 1 al sc 
covered in the , ' ; , we widespread and commercially important 
Its supposed 1 nitu d t Besides motion pictures and television, which 
by the titles of yt ( t} rts losely related to the present projection 
’ rte - s » 
written about a perfection of a similar system 
; prints might . simplify color 
Color Theory ne ‘ paper systems Cros, 1959 
New Theory t 


on the Eve’ ind § oO! ‘ in tile Land's discoveries 


I he ise over . a , . t ready to le ipplied to color photog- 
1 1 | ' 
originator ol Pe Maro i . f t r seems little question that 
minute will eventually lead to new 
techniques that will make 
ine 
. methods look primitive and clumsy 
bank Ketterit raqgiti il Cla - 
cle pecially should benefit from the 
ind pre dictror Trae a | wled hat the eye can utilize an entirely 
} re not bas ipo eT é t rt of information from what had 
of technology wight necessary to produce 
: 59, p. 205 
new types ol 
ranhyi Ives } ' dis ' 
Bape . . t will be noted that none of the 


tations is attributed to 


quo 
What he himself has said in 
is more conservative. T he whole 


sentation of his material was 

ned for the Proceedings of the 

onal Academy of Sciences. Only 

ts I and II have so far appeared 

1959a, 1959b), but they are 

ly dignified. His Scientific 

imerican article (Land, 1959c) is in 

nore popular vein, but Land says 

iat wherever it is more excited or 

seems to claim more than his other 

two articles, this represents editorial 

of discovery " St change over which he had no control. 

really Snakes ver He did not even know that the paper 

ff Cros (1959) was in preparation, 

d he disclaims responsibility for 

the extravagant article of Bello 
1959 


The story goes that early in 1955 


color material for the 

ur . but it makes no use of the 

ial principles Land thinks his pro- 

n phenomena have uncovered.—G.L.W. 
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Land did begin to consider the pos- 
sibility of devising a quick process for 
the Polaroid camera which would yield 
a print in color in a single while-you- 
wait operation. To begin to inform 
himself at firsthand of the problems 
that would be involved, Land set 
up, in three projectors, orthodox 
color-separation transparencies which 
had been prepared photographically 
through red, green, 
and blue gelatine ‘‘taking’’ filters. 
Screened in registry through similar 


conventional 


filters, the images built up additively 
a full-color reproduc tion of the orig- 
inal camera scene. 

While trying various filters, beam 
intensities, Land hap- 
pened to note that when the blue- 
filtered projector was turned off there 
was only a little deterioration of the 
quality of the reproduction on the 
screen. Ina further ‘accident,’ Land 
removed the filter from the green pro- 
jector. 


and so on, 


The intensified white light 


from it made the picture quite un- 
But 
trix, Meroé Morse (who for a decade 
has been Land's right arm 


satisfactory. Land's collabora- 
noticed 
that on the there were still 
traces of hues which seemingly should 
not have been there At the 
ment, this was dismissed as a ‘“‘fa- 
tigue’’ (afterimage) effect. Late that 
night, however, Land returned to the 
setup and dimmed down the white 
projector “Th the 
burst color” 
1959); 
long observation the color array per- 
sisted, it was clearly no afterimage 
phenomenon. 

From then on Land’s copy, whether 
still life or animate, was regularly 
photographed through 
filters. A positive transparency made 
from a_ black-and-white negative 
taken through a red filter (passing 
only the longer wave lengths) con- 


screen 


mo- 


stantly, scene 


(Bello, 
indefinitely 


into lifelike 


and with 


since 


only two 


WALLS 


stituted a “long record’ and was 
ordinarily, projected through a red 
filter. A negative simultaneously 
made through a broad-band green 
filter provided a_ black-and-white 
positive “short record” of the copy. 
lhis rather a medium record, 
considering what wave lengths and 


was 


energies would have come through a 
blue taking filter. The second pro 
jector, in which it was placed, usually 
had no filter over its front lens. 

Any 
was now represented on the screen 
by a patch of light 
neutral area of a particu 
lar density in the long record, and by 


object in the original scene 


red coming 


through a 


a congruent patch of white light sent 


through an identically shaped and 
sized area of the short record, having 
higher or a 
neutral The 
“object” was a particular ratio-and- 


red- and white-light lumi 


(except by chance) a 


lower density. screen 
sum ol 
nances 

An elaborate picture made up of 
just such objects “‘should’’ have pre 
sented them all as reds, pinks, whites, 
aud b’acks, depending upon the rela 
and the 


corresponding patches. of the long- 


tive absolute densities of 
’ 1 

and short-record transparency slides 

mixtures of red and white lights in 

3° field of such 


tricolorimeter 


the dark-surrounded 
an nstrument as a 
could not yield orange, yellow, green, 
blue, or purple. Land's screen images 
did 
over, in 
that is, 
were 


show all these hues and, more 
“correct hierarchical order” 
warm-colored objects of the 
the 


same warm colors on the screen, and 


copy rendered by about 
cool-colored objects were represented 
Skin 


more s0 


by cool colors in the picture. 
looked skin—in fact 
than in many Ektachrome and Koda- 


like 


chrome pic tures 
To Land's mind, here was a great 
mystery Where were all the extra 
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colors coming from, beyond those 


his projection lights could mix to 


give, when classical color theory 


could not explain them? By ‘‘classi- 
cal color theory’’ Land does not mean 
isolated color-vision theory (Young- 
Helmholtzian, Heringian, or other 

but this together with the relations of 
hues to wave lengths in the white- 
light spectrum, Grassmann’s laws of 
ilarly the 
| white, 


lights are 


color mixture, and parti 


fact that to obtain all hues an 


three additive primary 


considered to be necessary and sul- 


hicient 
If the light coming to the eve from 
a patch of screen was seen as having 


a color which a colorimetrist would 


not 


expect to see in a 


those if 


those two lights at 
then classical color theory was i 
Some el 


to be developed to 


quate and outmoded tirely 
had 
account for all the 
which obtained by 


one color projer tion on a scree! arm 


new theory 


unexpected colors 
one two-light, 
perhaps in no other way 
May 1955) I 
the first of his public lectures 
The 
the laboratory, to 
1957. In 


next, Land 


Quite soon ind gave 
with 
demonstrations then 


back 


emerge again in 


matter 


went into 


and the made presenta- 


scientiti 


tions to various 
and 


ton, 


meetings 
universit' 
Detroit 


and Columbia 


groups, at Washing 
Ro« hester, H irvard 
The order 
the phenomena came to be 
" 
} 


in which 
show 

was as outlined in Lan 
1959a 


s first pub 


lication where they are 


described as numbered experiments 


In an orderly way these experi 


ments bring out that: either the red 
picture or the white picture is mono 
but the registry 


makes a tremendous dif 


tone or achromatic, 
of both 
ference since appears 


the full 
instantly when a flood of room light, 


full color then 


picture reappears in color 


washed out the screen 
image, is turned off; enough room 
illumination can be permitted to en- 
able the perception of colors apart 
from the screen, and will not inter- 
with 


whi h has 


the colors on the screen; 
changing the subtense of an “‘object”’ 
at the observer's eye does not change 


fere 


its color; interchanging the long and 
short records turns red hair and lips 
greenish or blue-green, showing that 
the colors are not memory colors nor 
expectation colors; the hues seen are 
not much changed by large altera- 
tions of beam intensity ratios nor by 
the contrasts in the short 
record with superposed duplicates; 


doubling 


only red, pinks, and white are seen 
if the long-record slide is removed 
from the red-filtered projector—al- 
though many intensity ratios are 
still there; and so on. 

Land's oral presentations in East- 
ern cities never came strongly to the 
awareness of us who stay on the West 
Coast. I first learned of his projec- 


tion color phenomena when a col- 
travels much more, 
pressed Part | (Land, 1959a) upon 


me with 


league, who 
the solemn assurance that 
this was the most important develop- 
ment in color vision in the past 50 
years 
could 


than 


1 read it and forgot it, for | 
that anything more 
“simultaneous color contrast” 


not see 
was involved in Land's securing of 
hues from red to blue-green when his 
projection lights were red and green, 
“white."” Much 
Land's popular article (Land, 
was forced upon me, when | 


or red and tungsten 
later, 
195% 
was requested to deal with it as a sec- 
tion editor for a condensation jour- 
nal By this time Part II (Land, 
1959b) had appeared, as also the arti- 
cles in Fortune, Graphic Arts Monthly, 
Architectural Forum (Anon., 
which were stirring up great 
excitement and wonderment among 


and 
1959 
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all sorts of both scientific and non- 
scientific people.* 

In print and in Land 
makes about a dozen serious claims. 
They cannot be dealt with in either 
the direct or the order of 
their “importance,” for 
have to be explained before greater 
ones 


person, 


reverse 
lesser ones 
can be appreciated and 
versa. They will be taken up here, 
therefore, in order 
of comprehensibility. First, however, 
there is to be considered the ques- 
tion of novelty of fact. 

Land no longer makes a claim as 
regards the novelty of the rich vis- 
ual results of his simple means. In 
1955-1957 he learned that he was by 
no means the first that 
color-separation transparencies 


vice 


more or less an 


to find two 
are 
much more than two-thirds as good 
as three, and that they 
added, one color filter is much more 
than half as good as two. His latest 
article (Land, 1959c) hint 
that he knew this (perhaps, one ol 
the editor's doings? 
paper (Land, 1959a 
mitted it. As early 
picture 
which 
through 
through red and green filters, 
projected red and 


when are 


gives no 


but in his first 
a footnote ad- 
as 1914, motion 
were patented in 
taken 
a red filter and no filter or 


systems 


alternate frames were 


and 


through green 


2It appeared that I should d t 
publications and write, if ar 


ything, a com- 
te tol 


still other articles 


mentary covering all of them 
to ask whether there were 
which I should embrace that 
I was invited to Cambridge to be shown the 
phenomena on their home grounds. I might 
then find my pi or dis- 
armed, or even am grateful for 
the experience (early in July, 1959), 
say that Land and his devoted asso 
most kind, generous with 
facilities, and patient and fair in argument 
Statements here attributed to Land with 
out literature citation are to be considered in 
the category of “personal communications,” 
transmitted during my visit to his laboratory 


The upsh t was 


self unchanged in op 
converted. I 
ne must 
iates were 


their time and 
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ones or through a red alternating 
with none 

These systems, and various others 
which 


films which dodged 


two-dye 
difh- 
culties of making three-dye-primary 


used no filters, but 
the great 


films, gave excellent results so long 
as the cameraman could dictate the 
colors of the copy. Pure blues had to 
but 

outdoor 


lew 
that 
avoided, and the 
reproduction 
was If flesh tones, t.¢ 
skin then every 


thing else was good enough. It a 


be foregone; there are so 


such colors in nature 
they 


faithfulness of 


were easily 
color 
satistactory. 
colors, were good 
tually seemed a waste to use a three 
color process for a western movie, or 
even for indoor stories where furni 
ture and costume colors could be se- 
lected to which would 


avoid those 


come out “wrong.” 

Even Land's own favorite method 
for still not new. In a 
memorable Optical society 
in New York on March §, 


witnessed demonstrations by 


pictures is 
meeting 
1943, | 

Ralph 
Evans of Eastman Kodak Company, 
in one of which he projected long and 
short records taken through the same 
filters I 
and 


ind now and with red 


uses, 
yellow filters on the two pro 
jectors The hues on the screen, ac 
cording to notes made at the time, 


included red, orange, yellow, green, 
purple, and m 


Land has 


to one oft 


wenta. Unwittingly, 


even used subject matter 
Evans's own fav- 
girl 


a redhe ided wearing a 


green sweater. The two techniques 


could hardly be closer, for Land was 
then filters; 


and even when he is using no filter 


using red and orange 
on one 
from it 


vellowi 


projector and calls the light 
white, this is the strongly 
sh light coming directly from 
a tungsten filament 


With records of 


elaborate still-life copy such as as- 


long and short 
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semblages of groceries through a slender tube, only spots of 
brac, projected with red ar red, pink, and white can be found; 
beams or with red and_ yellow _ all other colors vanish. One can take 
(‘white’) ones, it is clearly n the same tube around the lighted 
results on the screen which are novel, room or outdoors, and view any- 
but Land's explanations of the thing and everything, but hardly 
Land's full-color results are only t any objects will change color hardly 
latest of a series of rediscoveries at all when seen thus. Land's screen 
the same phenomena st seen, it tures are most umnatural images. 
two-primary projected photogray Now it is perfectly true that the 
it least as early as 1897 wave lengths and energies at a screen 
\ claim, as good as any to le not determine the color 
mence with, is tha is j n there. But this does not mean 
iuse the subje i r is or hat the color is independent of the 
d rendered by od photography, light at that locus. It is utterly de- 
that the many colo peat al pendent upon the light in the ‘‘ob- 
What is on the screen, Land calls ¢ in relation to the light around 
total image, ;¢ omplete ima the object. Even in situations much 
natural-image situatior | ( pler physically, it is easy enough 
seen, except for those he pr i spot as having any of several 
tion lights and additi hues when spot and surround are 
thereof, do n ul nsti -d of nonselective materials 
lights are mixed u imple | la ! 1 al ninated by a single mono- 
Classic ( | hro light. The relative in- 

] created by relative reflect- 

inces are governing here, as shown 

by Helson (1938) and by Judd (1940), 

1 expressed in Helson’s principle 

d min I lor thes ol olor conversion’ with respect 

If changing the wave | o adaptation levels. In Land's ma- 
the colors, it does not do so accord ial, one ratio-and-sum of two 
ng to the rules of additiv ol projection lights represents the ob- 
ixture. The rays of differs wave t Other ratios-and-sums sur- 
length are 1 mselves color round it—if they were not “other,” 


making; in ad, color or ! vere would be no object, for there 


no contour. 
his own kind of quantitative 
lyses, Land has paid much atten- 
to the ratio of the intensity of 
some are longer and sor f ich kind of light in each object to 
The colors of monochrot ic ligh he maximal intensity of that same 


‘ 


and those of colorimet m uM light (at some place on the screen). 
are all one big special case, and ry le thus takes careful note of the 
one since Newton has been misl y relative intensity of each light in the 
it as regards how lor ise in object, and of the intensities of the 

itural’’. situation two object-lights relative to each 

It is easy to demon hat it other. He completely neglects the 
is Land's color array i the other absolute and relative inten- 
special case. If his screen i nned sities of the same two lights which are 
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hitting the screen around the ob- 
ject’s contours. There are spot-and- 
surround situations ali over Land's 
screen, and the color of any spot is 
at the mercy of a different spectral 
composition in its surround unless 
the luminance of the spot is much 
higher than that of the surround. No 
wonder, ‘hen, that the color seen in 
any spot seems to be “independent” 
of the phy sics of what is in the spot 
To a colorimetrist, Land's most 
prized phenomena would constitute 
intolerable Colorimetry 
must be done in a dark or at least a 
neutral surround. If 
matched by mixing in a colored sur- 
round of uncontrolled chromaticity, 
the specification found for the sample 
would be quite meaningless 

The explanation of his extra colors 
which Land obviously, 
vert, before expect our at- 
tention to any other explanation, is 
one in 
contrast. 
prefer is 
plementary hue)" for which I shall 
use induction for short, here. Still a 
third term for the same phet omenon 
is ‘lateral adaptation” 
(1943, 1948 
; and 
as being involved in the viewing of 
For the 
ind sur 


artifacts 


a sample were 


must contro- 


he can 


terms of simultaneous color 
The 


“spatial 


expression I myself 


indus tion tol com- 


| Vans 
with 


which 
points to, alor 


‘general”’ “local” adaptation, 


anv sort ot picture in « lor 
special case where both spot 
the same 
different intensities 


round have chromaticity 
but 
classic al 
work. 
There are certain 
duction which 
known, but 
Land's (with 
concealed there), and which can be 
brought out also in the simplest spot- 
and-surround situations. One usu- 
ally thinks of induction as it is shown 
off in an 


Helson's 


color conversion at 


facts about in 


are not yener ally 


which are involved in 


situations their action 


elementary laboratory 


WAL! 


course, with a square inch of gray 


paper laid large sheet of 


,] 


upon a 


colored paper. Here, the phenome- 


non seems tame indeed The com 


plementary coloration inducec { to 


the gray is not very convincing, al- 
though it becomes more so if a sheet 
is laid over all. 
tells 


the Corl 


of tissue Tongue in 
that 


this fa 


cheek one 


blurs 
cilitates induction across it 
The 


vivid when it is obtained on a screen 


students this 


tour, and that 
induction product is far more 
with 


i broad annulus of colored light 


surrounding a disc of white light 


from a second projector At an 
the 
is maximal. Here again, 
the effect is promoted if the mutual 
contour of surround and spot is de 
by 


disc 


optimal intensity of spot, its 


saturation 


de stroved., 
that 


out of registry 


liberately MOVINE 


either slide so and an 
i bit 
a flood of dim white light 
over with a third 
wr and gradually increased it 
is that 


is quickly 


nulus are 
If now 
put the screen 
one fin the colored 
washed out i 
the room would 
light 

' 


« the colored spot 1S as 


that any colored 
Kirschmann’s laws 
ntrary. Specifically, if the 

ue the spot is 
wash has com 
d the blue the spot 
still glows like a sun 
of the i duced color has to be seen to 

the white wash cannot 


Here is 


means ot support, 


is ever, 


yellow, 
the 


and whet white 


pl tely 


lesaturate 


The durabilit: 


be be lie ve | 


i out a color whi h 


as no visible and 


IS as unexpected as any color in one 
of Land's 

photometer 
light in the 
only white 


for, a 
show 


pictures; spectro 


will only white 


spot and the eve sees 


surrounding it 


When such colors are induced into 
the 
evel 


very real-looking objects which 


a black-and-white transparency 
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puts on a projection screen,’ their the spot. Truly white light in the 
vividness—-their apparent satura- spot would now appear white-minus- 
tion, if the term is allowable—is tre red, i.e., blue-green. But if the spot 
mendous light is itself a little reddish, some of 
Whatever hue is induced int i its direct redness can combine with 
spot is inevitably complementary) the induced greenness and a little 
whatever light, in the und, of the blueness to give a basis for 
doing the inducing his is not neutrality, and the remaining direct 
say, however, that the surro and redness and induced blueness will 
spot will necessarily be seen in make the spot purple. If on the 
plementary colors In Las other hand the spot light is yellowish, 
tures, this is rarely the cas " this direct huedness may kill the 
unquestionably infl blueness of the hybrid induced hue 
reject a ‘‘contrast”’ explar n n and allow the spot to appear purely 
the first place, mplementarine green. Furthermore, if a spot is sub- 
here is not in » Sel ’ ixtur tantially brighter than its surround 
complements hos red light t can exhibit the hue of either pro- 
which, mixed in a particular intensi ection light or any additive mixture 
tive ratio, will comprise a white light { the two, while in a spot much dim- 
the sense a colored | ‘+r than its surround, induced black- 
color of its ; r-in _ om in create maroon, navy blue, 
mixture complement light and olive, brown, and other “synthetic” 
ts induction or alter- com] surface colors. All of these possi- 
ment are n j n m hue bilities give way to others, with any 
there are differences a manipulation of the ratio and sum of 
reasons (Helson, wo kinds of light blended in the 
Wilson and Brocklebank, 1955 f round 
the second place, a physically f Land's extra colors have a kinship, 
itic surround may not apy onger than he admits, with colored 
colored at all; or the col 1adows. Produced on a screen with 
pot may be “mixed” from the dire wo projectors and a filter or two, 
color of the light actually there and shadow colors always come in pairs,‘ 
nother color induced y it which have interesting properties. 
surround is mix rom two beam 1 projection lights are colored 
light the rt Oo Y it not complementary, then quite 
regardless of what their colors are, 


in either case t } j 1 the hue ¢ neither shadow is ever the 


f 
ri 
to be seen as white u ons ? hue of eitl 


ier light since the surround 
wener il chromat 

the red lheht 1 ni ~ if i imiliar of all colored shadows, 

i owscape, May appear to 

il. When objects are illuminated 

yellow sunlight ard white cloud-light, 


were alone, ith « 


on of the re 


seen wherever an object blocks the 

light from the snow. The unseen (adapted- 

it) yellow surrounding the shadow induces 
wadays y mista r ste pe t ‘ plementary blueness into the white light 
rives from the corporea vh ges hav which, alone, occupies the shadow. No yellow 
when one sees them or e reiess screen and mate to the blue shadow is seen, because the 
not forced to m ina plane ( huge white cloud source creates no shadows at 
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of each shadow is not purely either 
light. But, the hues of the shadows 
are invariably complementary to 
each other. This fact has been known 
so long that its first discoverer is lost 
—while its most recent investigator 
(H. Self, a student of Helson’s) has 
not yet published his work. If the 
light from projector truly 
white and the other light is hued 
say, green—we have a special case. 
The hue of one shadow will be that 
same green the surrounding 
white-plus-green can induce nothing 
that will alter it; the hue of the other 
shadow will be red-purple, induced 
into the white light in the shadow by 
the impure green light outside the 
shadow. Here, side by 
“purely physical’ (green) 
and a “physiological-psychological” 
(magenta It is important to 
note that both shadow colors can be 
highly and equally saturated while 
the rest of the screen is 
white and necessarily 
either shadow—again 
Laws to the contrary 
With Land-type long- and short- 


one is 


since 


side, are a 
shadow 


one. 
ac ceptably 


brighter than 
Kirschmann’s 


record slides in red and white pro- 
jectors, one has only to displace one 
slide to throw the two records out of 
registry on the screen. One then sees 
that the 
represented by a set of colored shad- 
ows, not absolute but partial to dif- 


“objects’’ in one slide are 


ferent extents, but all of the same 
hue and differing only in saturation 
and lightness. The other slide is also 
putting up a set of shadows, of one 
other (and complementary 
of course the two hues 
and aquamarine.  [ pushing 
the displaced slide back into registry, 
one can think—for a time—that the 
additional all created 
simply by superimposing two com- 
plementary sets of colored shadows 
upon each other. 

When Land claims to be getting 


hue; and 
are salmon 


pon 


( olors are 


7 


4. 
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full color, this is an exaggeration 
in two respects. The term implies a 
faithfulness of reproduction of the 
copy colors greater than Land does 
get. It further implies that all possi- 
ble hues or obtainable, 
even if some objects have slightly 
wrong hues 


are there, 
The composition on the 
exhibit many, 
colors (a color being a hue at a given 
particular light- 
If the observer penetrates the 


screen does many 


saturation and a 
ness 
glamor of the multiplicity of satura- 
tions atid lightnesses creating ‘‘tints”’ 
and beautiful surface 
colors (present by grace of induced 
blackness), and resolutely hews to the 
hue circle, he finds that there 
gaps in it. Nothing on the screen is 
really blue without admixture of 
greenness, and nothing is green with- 
out with 


and “shades,”’ 


are 


contamination blueness 
Only in casual viewing can one think 
that some of the palest blue-greens 
are blue: some of the darkest, green 
Land had considerable trouble mak 
ing a lemon look like a lemon with 
red and white he told 
me that it took three months of trial 
and with taking 


posures, and darkroom work. 


projection 


error filters, ex 

What can be expected from vari- 
ous ratios-and-sums of red and yel- 
low illuminations inside and outside 


Red, pink, and 


white of course, with the whites being 


of object contours? 


seen wherever sums are high and the 
ratio of the two lights is the same as 
their 


(establishing 


nte grated ratio over the screen 

the 
I ‘neral ct j 

as his genera: chromatic adaptation 

level Wherever 

ratio occurs but with a lower or very 


observer's ‘“‘white’’ 


about this same 


low sum, there will be a gray or 
the ratio 
high, and 
there can be oranges and yellows. 
Then, there will be blue-greens in- 
duced by a strong red-light content 
of surrounds, e 


an 
U pset 
but keep the sum fairly 


acceptable black 


ven when these are 
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adapted out and appear white, or ex 
hibit induction 
Some of the 


greener, passing for 


colors themselves 


blue-greens will be 
green; 


Dhere 


blackness containing 


some 
bluer, passing for blue will be 
purples, 


syntheti 


and 


surtace colors tans, 
drab, et 
What more could one want? What 
thunderstruck viewer of this marvel 
would think to ask whether anything 
in the copy had been sky-blue? Is 
it just a coincidence that L 


browns, maroons, navy, 


ind’s dem 


onstration pictures have all been 


made indoors, and show objects he 


selected / 

Now that none of 
this is described, explained, or 
dicted by 
a bit 
complex science and a legion of color 
As old as 
the 
low 


for Land to say 
pre 
‘classical theory’ 1s to be 
harsh toward centuries of 
scientists livirig and dead 


any bran h ol color science 1s 
knowledge of induced hues it 
saturations, to be 


sure, 


prior to 
They 


were being exploited in ,the design 


electric sources and projectors 


in Thon is 
lifetime No one knows 


how long ago mothers began to teach 


of Gobelin tapestries 


Young's 


their daughters what colors to avoid 


so as not to afiect 


in hats and scarves, 
their facial idversels 
“*Accidental colors” 


ographed 


con plexions 

were be ings mon 

when people were still 

arguing over whether three pr 

and 

painting and printing 
It may be that none of Land's 


technological predecessors, with two 


were necessary sulficien 


beam, one filter color systems, knew 
their 
be that no one before 
Land had the photo 
graphic facilities, the filters, and the 
projectors with which to take 


just why 
well. It 
Evans 


systems worked ~v 


may 
and 


suc h 
full advantage of induction to pro- 
duce such breath-takingly beautiful 
pictures with such saturations of the 
But 


unex pec ted colors what needs 


to be explained is the long list of 
that are there and the short 
list of those that are not there, and 
this can be done without making use 
of any part of Land's explanation. 
One needs only old information and 
old language. In fact severa! lan- 
available: that of simul- 
taneous contrast, that of spatial in- 
duction, Evans’s three kinds of 
adaptation (1943, 1948), 
Helson’s principle of color conver- 
1938, 1955), and so on. 

Land explicitly denies that any 
sort of chromatic adaptation is re- 
sponsible for his color arrays: “‘The 
colors appear immediately, and 
do not alter appreciably with time, 
and we do not seek to explain them as 
effects of adaptation. To the best of 
our knowledge the gamut of color is 
much larger than that. . . predicted 
by any theory concerning chromatic 
(Land, 1959a). He 
demonstrated the immedi- 
acy of appearance of the colors by 
turning on strong room lights which 
obliterated the and 
then switching them off to show that 
‘no visible time lapse’’ occurs before 
the full-color effect is seen. A newer 
which he demonstrated to 
a double shutter with which 


hues 


guages are 


chromati 


Sion 


ad iptation”’ 


formerly 


screen image, 


device, 


<<, IS 


both beams of his dual projector can 
Even with 
a 0.01-sec exposure, the colors 
there. 


be flashed to the screen. 
only 
Land considers that 
inadequate time is being al- 
lowed for any adaptation 
idaptation cannot explain the colors. 
Land's trouble here is that in any- 
he has published, he shows 
awareness of only the long, slow, in- 
tensitive sorts ol adaptation which 
regulated by 


are all 
since 


process, 


thing 


are the cold-molasses 
kinetics of photopigment-concentra- 
tion change. The general and lateral 
chromatic adaptations which underly 
contrast phenomena are instant upon 


presentation of the stimuli (which is 
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why the contrast is called simultane- 
ous). They the 
alpha adaptation of Schouten and 
Ornstein (1939) than to the photo- 
chemical beta adaptation, and they 


are more akin to 


are readily accomplished by the ex- 
ercise of inhibitions in purely chro- 
matic pathways, leaving brightness 
vision Walls, 1955) 
No one to my knowledge has had the 
hardihood to try to the 
tiny time it takes for induced colors 


unaltered see 
measure 
to appear. Since the basis of spatial 
induction is neural and not photo- 
consumed is 


chemical, time 


hardly more than is required for a 


any 


neuronic message to traverse a couple 
fact, 
simple “persistence of vision’’ could 
allow a full induc- 
tion effects even if the presentation 


of synapses. As a matter of 


manifestation ol 


time of the stimuli were cut below 
the period consumed in the induction 
itself. 

By rejecting 
brings upon 
trouble in 
grays, as hued areas 
light there is, 
jectors etc., the 
colored light or some ratio of any two 


Land 


much 


adaptation, 
himself 


}uUSt as 


explaining whites and 
The less stray 
irom 


escaping pro- 


more surely any 
lights, mixed on the screen, will ap 
pear white. It is 
ence that even in the ruby 


a familiar experi- 
illumina- 
tion of a photographic darkroom, a 
piece of white paper is subjectively 
white. 
tions 


In Land’s projected composi 
there need be no broad white 
backgrounds, and there need be no 
broad 
formed by empty screen 


border 
Wh itever 
two lights he is projecting with, the 
observer's ‘“‘white’’ will be some in- 
tensitive ratio of the whether 
one light is colorimetrically white, or 
even if both 
case the ratio 
screen will be the 
adapts to, and he will see 


stray-illuminated 


two, 


are colored. In any 


average over the 
what observer 


white or 


WALLS 


gray in any discrete area that hap- 
that ratio. The 
heterogeneous the may 
chromatically, 


pens to contain 


more copy 
the 


closely the observer's white will ap 


have been more 
proach the ratio coming out of the 


projectors if the slides are removed 
from them and the intensity controls 
(already adjusted for best verisimuili 
tude) are left untouched. 

A con 
pregnant with several 
that the 


archical order of the colors in his pi 


Land's which is 


kinds of sig 


viction ol 


nificance is correct hier- 


4 
tures, the similarity of the color of 


each object to that of its model in 


the original copy, defies explanation 


' ' 
lassical theory or in terms ol 


under 
chromatic-adaptation 


etlect 


any sort ol 
phenomena. In he says that 
when he be yan to use his unorthodox 
primaries he was not expecting close 
verisimilitude, and has never strained 

it, but it is there anyway 

fact that 


hues ‘from 


he obtains a full 


red to blue’ 


nh Usinxn only red and yellow, or 
I 


that 


yellow green (et lights, 


¢ 


must seem the most magical aspect 


‘ 


of his results, to those who obtain 


their scientific information from pop 


izines. This degree of veri 


aer( ured so ¢ heaply, bs 


ins, is what 


pique 


or those who now con 


lower costs and higher 


hhotography , color 


color | 
lor printing, all as a 

And, it 
that 
out on his 
Seeit Z ho 


it in the stimulus situation, 


and « 
Land's 
verisimilitude 
d Land far 
limb. 


research 
Orin 
inally entice 
private theoretical 
basis for 
Land attributed the 


full-color gamut to a hitherto unsus 


fullness of the 


pected. property of the eve itself 


His own further tests of his hypothe 
build colored 


sis that ‘‘the eye can 


worlds of its own’ made with ap 
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paratus other than simple lanter: as it is in Kodachrome. At the same 
slide projectors, have served only to. time, paradoxically, it is due to a 


entrench it in hi T ‘ coincidence. 

The fact that in Land’ pourri When Land assembles some ob- 
pictures the right col lu jects with hues ranging from red to 
the most part, in b is blue and photographs them through 
only made to seem more remat red and green filters, then projects 
ible with red and yellowish lights, the 
hu he eve may a long record of a red object is of low 
tained on a lides density and lets through intense red 
projected have sten from ma ght, while the short record is dense 
terial that never 1 co d n nd lets through little of the other 
may make two mont oO light Naturally the red object is 
of neutral gelatine filters cen dto rendered red. A really green or blue 
glass plates, identical excepting tha bject is represented in the long 
each piece in one montas $ rey d record by a dense area and in the 

the other by ; ngruent piece of short record by a pale one. The 
a different ty rojectes shorter-waved (or the “white’’) light 
through the filter and predominates in the screen locus of 
might use, these will yield th ime he object. This light however must 

f necessity appear blue-green or 

green-blue. This is not at all be- 

cause the original object had such a 

but because the stronger red 

nation around the object-area 

particular color he screen induces its comple- 

ith “‘lor ind “shy ment, and this happens to be an am- 

rds photographed throu id biguous hue which satisfies the ob- 

with two different v leng ‘’r as a reproduction of either a 

nds of X rays (and, ni ‘en ject or a blue one as the 
color filters), ther pr ! f ise may be. 


try through « r filter whi is a beautiful coincidence, at 


te’ the radiopacity patter work for Land, that the complement 
of the subject n ya r of his red projection light is a blue- 
pattern easi ud ick gree! 


& Collins, lar fr 


insia 


so close to blue and so very 
r from red in the spectral series of 


hues. With selected copy the result 


' 
| ‘ 


i most full color, and the hasty 
translations of heads d t innot be blamed for calling it full 
colorized neutral montages, how is ! Only pure blue lies beyond 
it that the hues are series one does get, for violet is 
Land's pictures also it mak really a purple, the purples are extra- 
them click into place in th ( t ral anyway, and moreover 
objects, unless Lar s igt il ind's method does afford some 
thinking that the eye it put purples! The reason why pure blue 
them there because wil is not obtainable is not that blue 


‘ 


“natural image’? Sadly i s wave lengths coming from blue copy 


iypotheses, the verisimi| le in his pigments are stopped by the green 
pictures is just about s inevitable t iking filter used to make the short 
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record; it is that the long-wave pro- 
jection light employed has a hybrid 
hue, not a goo! blue, as its comple- 
ment. The projection lights, not the 
copy colors nor the taking filters, 
are the real determiners of the set of 
hues the screen can show. Land, 
however, thinks of them as the least 
important elements in the process, as 
we shall see. 

If anyone should fail to grasp the 
fact that the ‘nearly full’ color of 
Land’s pictures and their fair veri- 
similitude (excellent for 
colors; poorer and poorer 
too bad—for shorter-wave ones) are 
the results of a beautiful and beauti- 
fying coincidence, then I would ask: 
Suppose the physiology of color vi- 
sion were such that the complement 
of red was, say, yellow? How good 
then would be the verisimilitude? ' 

Land’s idea that hue is, or can be, 
independent of wave length, and his 
idea that the obtaining of rich colora- 
tion from two “primaries demands a 
completely new explanation, led him 
to conclude that ‘‘the eye can build 
colored worlds of its own out of in- 
formative materials that have always 
been supposed to be inherently drab 
and colorless.” When the retina is 
receiving only two kinds of light 
which are not different from 
each other “the eye" (=the visual 
system) is apparently able to reas- 
sign hue-sensations, which ‘‘belong”’ 
to the ends of the whole spectrum, to 
just those two lights, and the inter- 
vening hues to mixtures of the 
lights. 

From a biological point of view, 
this is by far the most important of 
Land’s claims. has pro- 
found implications for the course of 
evolution of human color vision and 
for its physiology—it de- 
mand a complete abandonment of 
such old-fashioned conceptions as a 
set of three or four receptor-types 


long wave 
but never 


very 


two 


It seemingly 


seems to 


WALLS 


each arousing immutably a unique 
elementary hue-quality irrespective 
of the wave length(s) of radiation its 
unique photochemical contents are 
absorbing. 

In order to determine how close 
together two projection lights illum- 
inating long and short records could 
be, i.e., how little of the Newtonian 
they could embrace and 
still give his full color, Land first con- 


spectrum 


templated using interference filters, 
with much narrower pass bands than 
Too much in- 
would be sacrificed for spec- 
Land had a high 
monochromator de- 

With this he could 
either record with 
igth, seeing the two 
images in registry by means of a 45° 
half-silvered 


gelatine have. 


ones 


tensity 
] 
' 


tral closeness: so, 
intensity dual 
signed and built 
transilluminate 
any wave let 
mirror. 

Land now found that with 
variety ol 


a wide 
pairs of monochromatic 
lights, he could secure full color. It 
has to be that Land 
uses the word as if it meant 
With wave lengths too close 
the were un- 
saturated, and when the lights came 


remembered 
“color” 
hue. 
together colors very 
from certain regions of the spectrum 
the gamut of hue itself was much re- 
stricted. Land has claimed to geta 
good result, however, even when the 
two wave lengths were 579 my and 
599 mu. The color illustration pre- 
Scientific American (for 

purports to 
what then appears on the mir 


pared by 
Land, 195% 


she Ww 


which 
ror is very hard to believe. 

One phenomenon appeared with 
the dual monochromator which ap- 
still puzzles Land, although 


yromiused 


parently 
he h is 
This 


versal.” 


a discussion of it. 
is what he calls “‘short-wave re- 
When both of the trans- 
illuminating wave lengths are short 
ones, the very few hues he then gets 
are in the reverse of a correct order: 
that is, the coolest-colored copy-ob- 
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jects come out.in the least cool hues 
[his corrects itself if he interchanges 
the records or the wave lengths so 
that a violet wave length illuminates 
the long record and a blue the 


one 
short. To my mind the 
this is that violet 
and blue does not, so that a 
wave length acts like a 
when it is paired with a blue 


The work dual 


chromator appeared to support 


reason ior 
has redness in it 
violet 
longer one 
with the mono 
the 
theory that when only the extremes 
of a short segment of the whole 300 
mu Newtonian spectrum are 

able to the reti the eve « 
“amazing versatility’ " 
spond with a full range o 

(i.e., of hues), by reassig: 

hues that belong to a 300-my stretch 
to the wave lengths within a stretch 
30 mu. Sor 


of only 20 my or iewhere 


a short range there is a 
point which, Land believes, 

“fulcrum.” W 
lengths longer than this, no matter 
their 


within such 
the eve 
establishes as a ive 


‘ 


what absolute va 
seen with hues which we tl 
belonging to the longwave e1 


full 
shorter 


spectrum, while wave 
than the 


responded to as if they were 


balance poi 
short (blue green, blue) eve 
lie in. midspectrun 

Out of this reassignment 
arose a 
Land has quite explicitly 
1959¢c) Suppose the pigt 


corollary hypothe S 


things around 
reflection-bands of 

ff such pigments could 
the 
Mi 
that 


h ippen to the 


that a number 


be crowded into a short piece of 
present visible spectrum, say 30 
or 40 my 


something 


lor “4 Suppose also 
should 
present solar spectrum reaching the 
earth's surface one might imagine 
light-absorbing materials getting int 
the atmosphere—so that only that 
same 30-40 was 


mu “spectrum” 


available to the retina. The colors of 
the things around us, Land believes, 
would be just the ones we see now. 
rhe reassignment phenomenon pre- 
pares us to be transported into any 
one of many “color worlds.” 

The basic idea of a “fulcrum” is 
not wholly wrong, provided one takes 
the position that it really expresses 
Land's own unconscious rediscovery 
of general chromatic adaptation. If 
projects pictures or shadows 
and blue-green wave 
lengths and gets red and blue on the 
screen, the red sensation is not being 

issigned to’ the yellow wave length 
but is induced by the blue-green one, 

nd the 


with vellow 


blue is not assigned to the 
but is induced by the 

yellow. One wave length would in- 
deed appear here to be a fulcrum— 
the dominant wave length of that 
Y-BG mixture which, through gen- 
eral chromatic adaptation, had be- 
“white.” But 
this wave 
length out of what is coming into it, 
d use it in a particular way, for it 


need not be present in either stimu- 


blue-green 


the observer's 


come 


the eye does not select 


With the original method using 


slide Land had found 
(unfiltered tungsten-) 
ght could serve as a “primary”’ just 
as well as the purest of color-filtered 
lights. The dual monochromator con- 
a pair of hinged white sur- 
faces, each of which could be sw ung 
the 
diffraction gratings and reflect the 
undispersed tungsten-lamp light 
through one slide to the 45° mirror 
ind the eye. This ar- 
rahgement enabled Land to confirm 
hat when shortwave monochromatic 
light came through the short record 
and white light through the long, the 
picture contained reds as tk h the 
white light were a long wave iength. 
When white light was sent through 


projectors, 


that “‘white’’ 
| 


t uined 


to position to occlude one of 


observer's 
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the short record and long-wave mon- 
ochromatic light through the long 
one, the picture exhibited blues as if 
the white light were a short 
length. 

This led Land to pose the question, 
“what is the wave length which is 
equivalent to white, the wave length 
than which white is neither longer 
nor shorter?”’ Such length 
would be that which the eye employs 
as “the fulcrum in the ordinary, sun- 
lit world,”” with respect to which the 
visual system assigns a redness sen- 
the 
wave length available and a blueness 
sensation to the shortest other wave 
length coming into the eye. With 
white light going through one record 
and light 
the other, the observer would find 
the fulcrum wave length as that one 
which made the picture go net 
monotone all over 

All but out of L 
subjec ts, told to watch a red “objec ig 
and rotate the 
until it started to turn green, 
the “fulcrum” at A588 +2 
sidering tl “white” 


wave 


wave 


longest other 


sory quality to 


monochromatk through 


itral or 


two ind’s many 
wave length control 
found 
Try Con- 
light here 


that the 


was again vellow tungsten filament 


is immediately ev 
with a sm 


that this was 


radiation, it 
to anyone 
colorimetry 
but a sil ple observat 
determination of the dominant 
length of the tungsten é 
that wave length which would have 


the same hue 


ment, 
Wave 
emission, 1.e€ 


o the observer as the 


tungsten light itself. No mixture in 
a surround, of any two lights having 
the same hue, however 
purity, could 
hue into any 
two lights in the surrounded spot. 
The two odd male, 
one female) who found a rather dif- 
ferent fulcrum”’ 
length must have had unusual lens 
unusual 


different in 
possibly induce any 


mixture of the same 
observers (one 
“sunlight wave 


pigmentations, luminosity 


WALLS 


Both 
had normal color vision, for I checked 
them with my own Nagel 
anomaloscope, which I had with me 


curves, or some such things. 
myself 


in Cambridge 
The dual 
made it appear that white light could 
of red, blue, or any 
color depending what 
light it was paired with; 
to show that 
could 


, 
monochromator work 


give a sensation 
upon mono 
chromatic 
and it seemed almost 


any wave length arouse a 
sensation of almost any hue, depend 
ing upon what other wave length, 
far enough away, i was paired with 
(Land, 1959b, 195% 


strate these things convincingly to a 


lo cle mon 


group, with something other than a 
one-man, eyepiece instrument, Land 


devised another apparatus in which 
fact that 


one particular wave length of mono 


he took idvantage of the 


chromatic light ts easily available at 


very high intensity from an inex 


standard sodium 
lamp emits A589 my 
e of his two “ 
1959b, 195% 


pensive source a 
Vapor h yhw i’ 

In on 
(Lan * 


transpare ncy 


sodium viewers” 
, a short-record 
the 
larged to natural size is transillumi 
tungsten lamps and viewed 
45° 
long record (reversed right 
for left is tran 


with objects en 


nated by 


through a half-silvered mirror, 
and Line 
silluminated by 


and 


so that. the two color-separ i 


, 
sodium luminaire seen in the 


mirror 


tion picture are 


| optically coplanar 


and cor gruent The observer looks 


into this viewer through a hand-held 


' , 
hiter wh 


green | 
and the 


h transmits A589 my, 
has the effect of a dual 


project ind-screen setup with 
green-filtered and 589 my projection 
lights. In the other viewer the \589 
my comes through the short record 
and the 
illun 
the 
than the dominant wave length of the 


short-recorc the 


recor j is 


thro igh 


long 


ited 


tungsten- 
a red filter In 
first ‘wer, A589 my is longer 


green filter; in 





second A5R9 1 


than 


viewer! 
the 
the red 

Lhe 


ind 


ips 


domi nt wave 
long-record filter 


of 


with 


picture groce! 


the 


‘ 


contains 


presents 
some obie 
wholly red, in 


of 


it 


part 

I 
is the AS&9 
pepper- 


in pepper 


here 


the i re 


y the red sensa I 


viewer, where A5 
stimulus, 


wave 


Her 


cool hues, 
book 


that 


I 
binding 
A589 


mip 


' 


or 

the ey 
to wave 
abundant! t 


The 


proves 


sod ! 


no 


what is making 
- 


the 


can red throug! 


( ! is dense 


in the long, 
brig! 


Si, 


£20 
the 


Ww 


] 
if i 


copy is notre 


relatively nter 


feeble 589-light 


Here 


I 
ik 


the 
) irple encoul 


I 


ess of the 
h 


' 


“4 


Car other ott 


entatior 


omple I 


ness to be SCC T ilone 
key to what ts reall: 


by the 


transpired when 


dividu 
demonstratior 


the 


t 


blu 


velop enough 


ne, pepper ‘ 
sh red, a mage I not de 


llowness to kill all 


ior 


‘ 


‘ 


there ne 
preset the 


A third and fourth 


he blueness that 
Another 
can purely red 


was I 


called 


person 


viewer,, 


43 


/ 


orangeish-red——for them, 
was more than enough yellow- 
or else less blueness in the hy- 
induced the 
een light. What was varying here, 


course, was the shape of one’s per- 


complement by 


il curve of “the intrinsic satura- 


) 


of the spectrum.” 


+ 
weTe 


rt 


ire other ways to describe 


the 
are all in languages, 
no supposition that “the 


led to be an instrument of 


red 
old 


rf 


bit 


put 


yenesis pepper-can, 


the, 


* 


‘Vea 
cted and awe-inspiring sub- 
So far as I am concerned, the 
4 the pepper-can is being seen 
the A589 my ts, but it is the 
lapted-out green in the can’s sur- 
i that is putting the red there. 


would induce 


he same surround 


redness into any other light substi- 


} 


, 


ted for the A589 my, just so its di- 
ect color was low enough in satura- 
In the red-filtered sodium 
it just as clear that any 
blue or blue-green seen in any 

| 


1S OTNTN 


of 
t} 


18 


; 


the expected induction 


lus he more intense red 


‘ ve surround, which readily 
verwhelms the direct yellowness of 
A589 mu 


irated locus in the spectrum). 


} 
i¢ 


vellow being the least 
Land, believing strongly as he does 
h that color vision works 

of hues to available 
ive lengths simply according as they 


theory 


iment 


assig 
nger or shorter, has been led toa 
pi about the evolution of 
hum vision which Bello 
1959) quotes directly from of 
Land's 1957 public lectures: ‘‘Would 
it be possible, in a system which had 


philosophy 


j 
il coor 


one 


only a pair of receptors balancing off 
against each other somehow, for the 
animal to have a sense of a full range 
of hues running from red, orange, 
green, down into blue? That 
inimal could see the leopard in the 
leaves in a way that his competitors 
couldn't. He would survive the leop- 


vellow, 
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ard ...and go on to build the world 
we live in.’” Elsewhere (1959c) Land 
has said: 


. we have not been describing a two-color 
theory of vision It is true, however, that 
our experiments deal with two packages of in- 
formation ... the eye can do almost every- 
thing it needs to do with these two packages 

. . there is not a very big gap in the s¢ 

scale to be filled... the visual process will 
remain an amazing one from the evolutionary 
point of view. Why has a system that can 
work so well with two.packages of information 
evolved to work better with three we 
feel that the big jump is obviously from one 
to two (p. 99). 


sation 


Translated into which 
most color-vision researchers would 
use, this means that Land views the 
course of evolution of primate color 
vision thus: ing! 


language 


Originally, a single re- 
ceptor-type afforded only monotone 
the 
differentiation of this into two types 
the system became able to give to 
consciousness the hues 


or achromatic imagery Upon 


from red to 


bluish blue-green, some purples, neu- 


trals, surface colors containing 
blackness), all by the ex- 
tremes of the hue series to the ex- 
tremes of any available stimulatory 
wave length band. the 
only hue missing was purest blue. It 
is hard to see why the organism went 
on to add 50% more mechanism (a 
third receptor-type and all accessory 
neurons) just to secure this one more 
hue for the sensory gamut: but this 
did happen. 

The catch here is a double one. In 
the first place, at a point in evolution 
prior to the invention of a blueness 
receptor in the retina, the higher 
levels of the system would not have 
embodied mechanism for putting any 
blueness into any whether 
by induction or otherwise. Man's 
present three-component system af- 
fords redness, greenness, and yellow- 
ness synthesized from their 
together with blueness, and all of 


assigning 


Essentially 


sensation, 


bases, 


WALLS 


these hue qualities, either singly or 
in blends of two, can get into sensa- 
of indeetien—when 
only red and yellow (say) lights are 
impinging upon the retina. But these 
lights, or any two others, or any one 


tions—courtesy 


light, activate all three components 
of the 


comporne 


system. In an earlier, two- 
nt stage of the system, no 
more hue qualities than red, possi- 
bly (but probably 
green could have been enjoyed. 
Land (1959c) errs in saying that 
the central the 
ponent theory of color vision is that 
“the eve responds to three different 


kinds of and all 


sensation is the result of stimulating 


not) vellow, and 


idea of three-com- 


vibr ition, color 


the three responses in varying degrees 
of strength.’ He attributes this to 
Maxwell 


stead 


and Helmholtz, who in- 
that 


Is to some extent to every 


believed each rec eptor- 
type respor 
| 


wave length in the visible spectrum 
One has to go back to Thomas Young 
for the short-lived that each 
receptor is primarily by 
(one “‘kind of 


and responds at all to 


idea 
a¢ tivated 
one bit of the spectrum 
vibration’ 
only in 


neighborir frequencies 


“forced Land seems to 
think that 


lights, t 


uses two projection 
hue of 


bh] 
muUchess 


neither of which 


has any about it, he is 
stimulating only 
the third 
have evolved 


two components 


and might as well never 
all the hues now seen 
wih a 


being 


three-com- 
those which 

Id | » been seen bv the ren » 
would have Deen seen Dy the remote 


by an obser ver 


ponent system 


ancestor who did not yet have any 
blueness component at all. 


In the 


witl 


have 
two-component systems 


second place, we 
people 
all around us—the dichromatic color 


blinds 


diffe rent 


They comprise three or four 


very types, but we know 
that not one of them sees more than 
two the white-light 


The color-normal experi- 


hues in entire 


spectrum 
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ences perhaps 40 hues.* Dichromatic by a considerable sympathy for 
vision is “a big jump" above mono- Land. I myself am not qualified to 
chromatic, but it does not afford quantify anything more complex 
40—(pure blue 39 hues Even than my bank balance. 

though the color-normal sees many Land's coérdinates are Cartesian, 
more colors in a Landian two-pro but nothing else about them is con- 
jector picture than the simple stimuli ventional. The ordinate axis is a 
seem to be worth, this would not be logarithmic scale of “percentage 
true for a dichroma For him, any ivailable long-wavelength stimulus” 
wave length to one si neutri and the abscissa axis bears a log 
point can induce only the same one- scale of percentage available short 
ind-only other hue at gets wave length stimulus. With long and 
directly from any wa ngth on short records in projectors or in the 
the other side the 1 il point. dual monochromator, and any two 
With long and cords pro projection lights, any point on the 
iected throug! | and 1 filter screen finds a place also as a point 


a normal may 1 graph with these coérdinates. 


oranges, yel , cl ise, gree! When the beams have been regu- 


' 


blue-greens, nd ne lated for best color array, the short- 
tritanope standing alongside ld record illuminant is cut off and the 
not see more n I cine “ maximal intensity of the long record 
and one kind of greet cl image is found and measured, with 
ous saturations wn to z ne this luminance then taken as 100%. 
tral he relative intensity at any other 

While most o and's , locus gives an ordinate value for 
search thus has d mucl that locus. Abscissa values are found 
ido about nothing new, it woul » in the isolated short-record image, as 
1 mistake to say that it is ju percentages of the highest intensity 
flash in the I ( ind’ anywhere in the image. One point on 
new codérdina ‘ m nd the the graph may, of course, represent 


relationships he can extr fro1 any number of image points where 


ire probably salvageable (al the same absolute luminances of the 
Judd's 1940 formulations might be two kinds of light happen to occur. 
as fruitful in the projected-color situ These various physically identical 
ations, or more s It y well be image loci should not exhibit the 
that in the hands of Land and others same color unless they all have identi- 
the coérdinate system w nable a_ cal surrounds; but Land appears to 
quantification and accurate predi claim that they do, since on a sample 
tion of induction products which graph, given in all three of his papers, 
never could have been had, or had he labels single points with single 
easily, without it. This may »only color names. 
my own wishful thinking, stimulate: Each point on the graph repre- 
a oe soe ie 0 ‘monly sents a relative intensity relative to 
snnaine thas Chane ut 120 Hminable @nother relative intensity, and is 
hues in an equal-brightness spectrum and 20 supposed to describe and predict a 
40 extraspectral purples here may be 120 =unique color on the screen. This has 
values of AA, but each is a complex of hueand helped to make it appear to Land 
enn denereieds te an eben ete that ‘‘the eye turns brightness ratios 
trum. It is not a “hue discrimination .arve," '™tO colors’ (Bello, 1959), although, 
but a wave length discrimination curve as pointed out above, he considers 


saturation The « SA ps A” has never 
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only ratios in and neglects 
ratios in surrounds and ratios of spot 
ratios to surround Land 
emphasizes that his coérdinates are 
dimensionless, scaled in naked num- 
bers. Actually, since a new graph 
has to be made for 
color-separation 
every pair of lights used for every 
picture, the 
calibrated directly 
It is hard for me to see why they are 


spots 


ratios 


every pair of 


positives and for 
coérdinates could be 


in log luminance 


not, for the percentage s« ales do not 
generalize or universalize the graph 
The predictive values of any 
graph are confined within itself, for 
that graph can tell nothing about 
what colors will be seen, or where, in 


one 


another picture with other lights or 
even with the same lights 

Land soon noticed that all of the 
whites, grays, and blacks on the 
screen plotted along a 45° line in his 
coérdinate system This is logical, 
for on the 45° the arithmetic 
ratio of the intensity of one light to 
the intensity of the other is a 
stant. If a screen 


line 


con- 
point this 
ratio and some sum appears neutral, 
any other point with the same ratio 
and another sum appear 
neutral; and this the 
which ordinarily would exist all over 
the screen if the slides should be re- 
moved from the apparatus. Land 
calls the 45° line the “‘neutral line’ 
or the “gray line’’; it 
be called the 
adaptation line’ or the 
level." Since warm 
sarily plot above the 45° 
cool colors below it, 
whence came Land's that the 
Newtonian spectrum is a physical 
artifact of prisms and gratings and 
that the real visual scale of sensation 
runs from warm hues through neu- 
trality to cool hues. 

One has to read with caution 
Land's description of the properties 


with 


should 


ratio 1s one 


could as well 
“general chromatic- 
“adaptatior 
colors neces- 
line and 
one readily sees 


idea 


WALI 


than the 45 
i graph in his coérdinates 
tracks” 
the or 


of straight lines other 


one, on 
He calls 


and 


them ‘achromatic 


includes among these 
dinate and abscissa axes themselves 
Just as one has to know that 


L ind 


also one has to ki ow 


when 


says color he hue, so 


means 
that 


means 


when he 


hromatic he achro 


SAYS al 


mati monotone—he makes no 


distinction between a set of screen 
points wh h all have the same hue, 


Any- 
is likely 


and a set which all have no hue 


thing short of full color, he 
to dismiss as no color 

Among these‘‘achromatic’’ straight 
the 


still straight) gray line 


line loci are rotated or dis- 
(but 
which results from doubling the con- 


trast in one 


placed 
image (by using two 
layers of short-record transparency) ; 
i line at right angles to the nor 

Such a the 
ill that one can get on the 
projecting any 

with a 


and 


mal gray line line is 


lox us ol 


screen by 


negative 


in registry positive made 


irom it This is not necessarily an 


“achromatic’’ (monotone) situation, 


for the line may cross the gray line 
ie into the 
although one 


whites if 


and contint “cool” area: 
sees only reds, pinks, 


a dark 


a red filter and the bright 


and 
through 


negative goes 
positive through none, one may get 
and blue-greens if the 
positive iS red filtered and the nega 
tive is 

This combina 
tion serves to exemplify some situa- 


reds, neutrals 
tungsten-illuminated. 
negative—positive 
tions which puzzle even Land, and 
On the screen, 
each object may be represented by 
the 
tensity of 


baffle me completely 


ratios of in 
the projection lights that 
on the screen if long- and 
the 
the negative-posi- 


one ol very same 
would he 


short-record positives were in 
But 
tive screen picture is monotone or at 
This is not because the 


negative is always so dense that all 


projec tors 


best bicolor 
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surrounds contain essentially only 
the positive projec tor's kind of light 

Land convinced me of that by pro 
jecting a negative and positive of his 
“standard objects slide” (illustrated 


in Land, 1959a 


the 


cCOpy was a mid 


gray, it is about equally translucent 


where, 


since 


ba kground in the 


in both positive and negative 
Another 
matic’ 


mysteriously “achro 


situation is obtained by pro 
jecting three identical positives made 


irom any color separation 


negative 
with two superimposed 
one projector, the third alone 


other 


or not) 


projector, and a c 


over éach lens. The screen loci 


receive an enormous number of 


of the two kinds 


Perhaps Land's ‘doubled 


ransparencies have alwavs been 


dense over most of their rea, for | 


have learned of two other people, 


who have work in progress on this 


matter, who do get the various hues 


the ‘three identi i] mages situa 


tion 
| hus, 


brightness ratios 


there are 


turned 
I don't ki 


always get new colors 


eves 


ure of two colored lights 


rounded by another mixtt 
same lights In all of the 
Land finds to be 


common 


achror 


is a leature, 1 there 


are regular progressions ot ratios 
This in itself is enough to lead him 
to expect no gaudy results. He justi 


fies his use of elaboratelv-cor iposed 


photographs to be yin with instead 


ot “s ientific”’ 
and 


sell 


id-surrounds 
Mun 
papers) by insisting that ran 
the 
ratios 


montages of “scientific 
domness of light in 
their 


over the screen 


pro} ction 
and ol 
graphic distributior 


tensity topo 


is essential for the varicolored effect 


i 
Such randomized configur 


itions are 


natural; and it is in natural 
images that he has found the truth 
about color vision. 

One of the tests with which he 
‘proves’ the necessity of random- 
and the color-killing effect of 
regularizing in any way the intensity- 
ratio array on the screen, is the ex- 
periment with neutral step wedges. 
With two such wedges in place of 
one oriented horizontally in 
one projector and one vertically in 
the other, and with a red filter over 
one projector, one gets on the screen 

nly a huge square which is red in 
white in the opposite 
rner, and pink in between. Yet, a 
great number of intensity-ratios of 
the lights are there (256, to be exact), 

as in one of Land's beautiful 
long-and-short-record pictures. 

When | asked for black grids to be 
the which would 
registry on the 
and this was done, the screen 
but ex- 
Any illumi- 
ited square now had, nearest to it, 
which the ratios 
were different enough to be capable 
of inducing something into the first 
lo my own satisfaction this 


he Says, 


ness, 


slides, 


one corner, 


put on wedges, 


themselves be in 
screen 
a no 


bit “cl 


longer monotone 


several hues. 


other squares in 


oq iare 
showed that it is not randomness per 
se but discreteness that is essential, 
for the ratios in the squares were still 

1 regular topographic array. The 
virtue of Land's photographs of 
hodgepodges is that the easy way to 
get discreteness—local changes of 
ratio large enough to create contours 

is by permitting randomness, which 
is rife in just such photographs. 

And this, I can strike my 
closing which is that I am 
quite content with being able to ex- 
plain why Land gets what he does 
get, using only old knowledge and 
old language making no 
whatever of Land's fantastic new hy- 
1 leave 


with 


note, 


and use 


potheses and new concepts. 
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it for others to explain why he 
doesn't get what he doesn’t get, i.e., 
why the “unexpected” are 
lacking where he has come to expect 
them, as in his various ‘ 


colors 


‘achromatic”’ 
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As psychologists who perform i 


1 research capacity are well aware, 


psyc hologi al data too frequently 


have an exasperating ter dency to 
manifest themselves in a form which 


violates one or more of the 


assump 
tions underlying the usual statistical 
iced with the 


the 


tests of significance. | 
problem of analyzi: 
researcher usually 
form them in su 
assumptions are 
look elsewhere 
rhe latter 
popular because of the proliferation 


sO-( alled nonparan 


‘ 
aiter! become 


etri 
Chese 
} 


noweve!l 


of the 


methods 


distribution-free 
techniques quite generally 


n restricting 


( ouple their freedom fror 


assumptions with a disdain for much 


of the information contained withi 


the data. For exa: ple bi 


] 
} 
i 


scores into groups above 

the median one ignores the fa 
there are intracategory diffe: 
between the individual 

result, tests which 
about the 


W“ hic h one 


distribution from 


iS Sal ipling will tend not 


tions 


to reject the null hypothesis when it 


is actually false as often as will those 
tests which do make 


This lack of 


issumptions 


! 
the nonpara 


p wer } 


ndertaken while the 
Research 
Mental 


he nr . 
The computa 


1 This was 
author was a Public Health Service 
Fellow of the National Institute of 
Health at Duke 


tions involved in this st 


project 


University 


idy were performed in 


the Duke University Digital Computing Lab 
which is supported in part by Na- 
Science | Grant G-6694 
The author wishes to express his appreciation 


to Thomas M 


tory, for his cooperation an assistance 


ratory 


tional oundation 


Gallie, Director of the Labora 


a decided handicap 
as is frequently the case in 
psychological research, a modicum 
in the form of an 
significant result is re- 
quired to maintain the research re- 


metric tests is 


when, 


of reinforcement 
occasional 
sponse 
Confronted with this discouraging 
prospect and a perhaps equally dis- 
one of laboriously trans- 
data, performing related 
tests, and then perhaps having diffi- 
culty in interpreting results, the re- 
searcher is often tempted simply to 


couraging 


lorming 


such 


ignore considerations and go 
ahead and run a ¢ test or analysis of 
variance. In most cases, he is de- 

red by the feeling that such a 
procedure will not solve the problem. 
If a significant result is forthcoming, 
s it due to differences between means, 
or is it due to the violation of assump- 
Che latter possibility is usually 
sufficient to preclude the use of the 
tor F test. 

It might be suspected that one 
could finesse the whole problem of 
by better 
planning of the experiment or by a 

re judicious choice of variables, 
but this may not always be the case. 
Let us examine the assumptions more 

It will be recalled that both 
test and the closely related F 
test of analysis of variance are pre- 
dicated on sampling from a normal 
A second assumption 
required by the derivations is that 
the the distributions 
from which the samples have been 


tions?’ 


intenable assumptions 


1 ] 
Closely 


the if 


distribution. 
variances of 


taken is the same (assumption of 
homogeneity of variance). Thirdly, 
i that scores used in 


49 


it 1s necessary 
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the test exhibit independent errors. 
The third assumption is usually not 
restrictive since the can 
readily conduct most psychological 
research so that this requirement is 
satisfied. The first two assumptions 
depend for their reasonableness in 
part upon the inherent in 
empirical data and the chance shape 
of the sampling distribution. Certain 
situations also arise frequently which 


researcher 


vagaries 


tend to produce results having in- 
trinsic non-normality or heterogene- 


ity of variance. For example, early 


in a paired-associate learning task, 
before much learning has taken place, 


the modal number of responses for a 
group will be close to zero and any 
deviations will be in an upward direc- 
tion. The distribution of responses 
will be skewed and will have a small 
variance. With a number 
of trials, scores will tend to be spread 
over the whole pe yssible range with a 
mode at the center, a more nearly 
normal distribution than before, but 
with greater variance When the 
task has been learned by most of the 
group, the distribution will be skewed 
downward and with smaller variance 
In this particular case, one would 
probably more closely approximate 
normality and homogeneity in the 
data by using some other measure, 
perhaps number of trials for mastery 


medium 


In many situations this option may 
not be present. 

There is, however, evidence that 
the ordinary ¢ and F tests are nearly 
immune to violation of assumptions 
or can easily be made so if precau- 
tions are taken (Pearson, 1931; Bart- 
lett, 1935; Welch, 1937; Daniels, 
1938; Quensel, 1947; Gayen, 1950a, 
1950b; David & Johnson, 1951; Hor- 
snell, 1953; Box, 1954a, 1954b; Box 
& Anderson, 1955). Journeyman 
psychologists have been apprised of 
this possibility by Lindquist (1953) 
who summarizes the results of a 
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Norton (1951). Norton's 
technique was to obtain samples of 
Fs by 
procedure from distributions having 
but which violated 


study by 


means of a random sampling 
the same 
the 


homoge! eity 


mean 


assumptions of normality and 
of variance in prede- 
termined fashions. As a measure of 
the effect of the violations, Norton 
the obtained percentage 


of sample Fs which exceeded the the- 


determined 


oretical 5% and 1% values from the 
F tables for 
the null hypothesis is true, and if the 


various conditions. If 


assumptions are met, the theoretical 
values are / 
wiadt * 
exceeded by chance 
1% of the time. 
tween these expected percentages and 


values which would be 
f 


exactly 5°) or 
7 he disc repancy be- 


the obtained percentages is one use 

ful measure of the effects of the viola 

tions. 
Norton's 


rized briefly as follows: (a 


may be summa 
When the 

came from the 
the shape of the distribu 
tion had very little effect on the per 


results 
samples all same 


popul ition, 


centage of / 
theoretical! limits 

the 
theoretical 


ratios exceeding the 
For example, for 
level, 
ceeding the 


7.83% for 


the 5% percentages ex 


limits were 
a leptokurtic population 
as one extreme dis repancy and 4.76‘ ( 
for an extremely skewed distribution 
as another b) For sampling from 
populations having the same shape 
but different variances, or having 
different shapes but the same vari- 
little effect on the 


empirical percentage exceeding the 


ance, there was 
oretical limits, the average being be 
tween 6.55 and 7.0%. (c) For sam 
pling from populations with different 
shapes and heterogeneous variances, 
a serious discrepancy between theo- 
retical and obtained percentages oc- 
curred in On the 
basis of these results, Lindquist (1953 
p. 56 that 
heterogeneity of either form or vari- 


some instances. 


concluded ‘unless the 
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ance 1s so extreme as to be readil 


apparent upon inspection ol the data 
the effect upon the F distributior 


will 
probably be negligible 
rhis conclusion has apparer 
surprisingly little effect 
statistical habits of res 
(or perhaps editors 
from the increasing 
le powerful nony 
published 


this 


the inv 


niques i 
purpose ol 
further 
test and its nex 
ordinary onsla 
the 
hor 
this will be done 
of a study cor 


dealing with the 


violation of 


mality and 


of violation of 
tio Supporti 
mathematical frar 
to bolster the i! 
lo temper ani 
in the foregoing 
that 


which preclude 


sized there 


regard for 
these 
It is apparent 
violation of the 


ince issumMmp 


turbing to the d 
Fs if the san ple 
for all groups, a 
not considered i 
It ilso seems cle 
extreme violatior 
Sati ple size iarvge Nou } i¢ alle WwW 


the 


to come into play 


1 etiects of 


The nee 


considerations will be made 


qgiscussion 


statisti averaging 
1 for such 
ipparent 
There 1S 
abundant that 
both the ¢ and the F tests are much 
affected by 
of the assumptions than has been 


generally realized 


in the ensuing 


evidence, hows ver 


less extreme violations 


4SSUMPTIOD 


UNDERLYING THE t TEST 

A SAMPLING EXPERIMENT 
At this point we will concern our- 
with the the 


selves statement of 


results of a random sampling study. 


Che procedure is one of computing a 


irge number of ¢t values, each based 
upon samples drawn at random from 


listributions specified char- 
fre- 


distribution of the obtained 


having 
icteristics, and constructing a 
wency 
lhe present study was performed 
the IBM 650 Electronic 


progr immed to perform the 


Com- 


ry operations which can be 
the gener- 
the 
the random num- 


irized as follows: (a 

1 random number, (6 
ition ol 

1 random deviate from the 

iate distribution, (c) the suc- 
imulation of the sums and 
squares of the random devi- 

ntil the appropriate sample size 
ached, (d 


} 


iseU upon 


the computation of a 
the sums and sums of 
ires of the the 

of the t's on the basis of size 
and the construction of a 
listribution 


two samples, (¢ 


based upon 


ng operation. The complete 

e of operations was performed 

the result, the fre- 

listribution of 1000 t's, being 
nched out on IBM cards. 

many of the above 

ms are relevant and will be 

iccording to their order above. 

The random 

sisted f 10 


end 


ner on 


numbers con- 
the middle 10 
digits of the product of the previously 
ited random number and of one 


digits, 


ames 
of a sequence of 10 permutations of 
the 10 digits (0, 1, 2, , 9) placed 
is multipliers in the machine. To 
start the process it was necessary to 
place in the machine a 10 digit ran- 
dom number selected from a table of 
randon The randomness 
generated in such a 
fashion was checked by sorting 5000 
of them into 50 categories on the 


numbers 


of numbers 
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basis of the first 2 digits. A xy? was 
computed to determine the fit of the 
obtained distribution to a theoretical 
one consisting of 100 scores in each 
of the 50 categories. The obtained x? 
of 47.83 is extremely the 
49.332 value, which is the theoretical 
median of the x? distribution with 
50 degrees of freedom. 

(b) In order to obtain the random 
deviates (the individual 
scores from the appropriate popula- 
tion), the random numbers obtained 


close to 


random 


in the above fashion were considered 
to be numbers between 0 and 1 and 
interpreted as the cumulative prob- 
ability for a particular score from the 
prescribed population. From a table 
entered in the machine, a random 
deviate having that probability 
selected. This is identical with the 
procedure one uses in entering the 
ordinary 2z 
score below 


was 


table to determine the 


which, say, 97.5% of 


the scores in the distribution lie. The 


obtained value, 1.96, is the deviate 
corresponding to that cumulative 
percentage. The distribution of such 


deviates from 
obtained by random 
sample of probabilities is normally 
distributed. 
constructed for other populations 
The populations selected for this 
study were the normal, the expo- 
nential (J-shaped with a skew to the 
right) having 
y=e-*, and the rectangular or uni- 
form distribution. 


a normal population 
using a large 


Similar tables can be 


a density function of 


These distribu- 
tions represent extremes of skewness 
and flatness to the 
normal. The tables of deviates cor- 
responding to each of the selected dis- 
tributions were contained internally 


compare with 
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in the computer and were so arranged 
that the 
was 0 and the variance 1. 


mean of each distribution 
To verify 
these values, population means and 
variances based on samples of 5000 
deviates from each of the three popu 
the usual 
The results were for the 


lations were estimated by 
formulas 
normal distribution a sample mean 
of .0024 and a 1.0118, 
for the exponential a mean of .0128 
and a variance of 1.0475, and for the 
rectangular a mean of 0115 anda 
variance of .9812. All of these results 
could quite easily have arisen from 


variance of 


random sampling from distributions 
having the assumed characteristics 
To change the size of the variance of 
the 


multiplied when necessary by a con 


population, all deviates were 


stant, in this case, the number 2. The 
resulting distribution has a mean of 
0 and variance of 4. The only vari 
neces used in this study were 1 and 4 
The sample sizes selected were 
and 15 
(d) The formula used for the 


putation of ¢ was the following: 


where M,; and M; are 
the first and second samples and N, 
and WN, are 


51Zes. 


the means of 


the respective sample 
Chis expression, or an equiva- 
lent statement of it, is found in any 
book undoubtedly 
in a preponderance of the 
in which 


statistics and is 


employed 
research a ft test involving 
nonrelated means is used. As pointed 
texts, this test 


when 


out in most statisti 


is not appropriate variances 


are different Tests available 


more or less legitimate un- 
der these conditions, but a certain 


are 
which are 


amount of approximation is involved 
in them. It was felt, however, that 
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the ordinary ¢ test might under some 
conditions be as good an approxima- 
tion as the more complex forms of ¢ 
tests and that a this 
notion In addition, 


makes 


verification ol 
was desirable 
the above formula use ol a 
pooled estimate of variance for the 
error term and in this respect is simi 
lar to the F 
Because of 


test of analysis of vari 


ince this fact, certain 
results can be generalized from the f 
to the F test 

To summarize, 


random samples 


were drawn from populations which 
normal, rectangular, or 
with 


and variances of 1 or 4 


were either 
exponential means equal to 0 
For several 
combinations of forms and variances, 
P 


t tests of the significance of the differ 


ence between sample means were 
computed using combinations of the 
each of 
eTicy dis 


obt ined 
Electror i¢ ( om- 


sample 81Z¢s 5 and 15 For 


these combinations, requ 
tributions of sample 


IBM 650 


Ss were 
on the 
puter 


The results of the sam; 
will be presented in part 


eries 
of frequency distributions in the form 
of bar graphs of the obtained distri 


! 


tribution of t's for a parti ir condi 


? 
dition Upon these ha *‘n super 
imposed the theoretical ¢ distribution 
curve for the appropriate degrees of 
This furs 


parison of the exter: 


freedom. ishes a rapid com 
t to which 
pirical distribution conforn 
theoretical 

First we shall consider those combi- 
nations possible when both of the 
samples are from normal distribu 
tions but variances an 
vary. Next 


results of 


' 
Sample sizes 
lered 


from non- 


' 
{ 


may will 
the 


normal distributions, but both sam 


e consi 


sampling 


ples are from the same type of dis 
tribution. Finally we deal with the 


results of sampling from two differ- 


SUMPTION 


UNDERLYING THE t TEST 


ent kinds of populations, for example, 
one sample from the normal distri- 
bution, and another from the 
ponential. 


ex- 


Potentially, a very large number of 
such combinations are possible. Limi- 
tations of the time available on the 
computer necessitated a paring down 
to a re Although 
the computer is relatively fast when 
optimally programmed, it neverthe- 
less required almost an hour, on the 

frequency 
The combi- 
here are 
which seemed most important at the 
time the study was made. 

\s a measure of the effect of viola- 
tion of assumptions, the percentage of 
obtained t's which exceed the theoret- 
ical delineating the middle 
95° of the ¢ distribution is used. For 
8, 18, and 28 df which arise in the 
study, the corresponding 
values are respectively + 2.262, 

2.101, and +2.048. If the as- 
sumptions are met, and if the null 


hs 


ibie number. 


ison 


to complete a 
distribution of 1000 ?’s. 


average, 


nations those 


presented 


values 


present 


pothesis of equality of means is 
true, 5° of the obtained f's should 
fall outside these limits. The differ- 
ence between this nominal value and 
the actual value obtained by sam- 
pling should be a useful measure of the 
which violation of as- 
sumptions changes the distribution 
There is, of course, a ran- 
dom qu ility to the obtained percent- 
age of t's falling outside the theoretical 
limits Hence, the obtained value 
should be looked upon as an approxi- 

the true value which 
nearby. 


degree to 


ol { scores. 


mation to 
should lie 
In the figures and in the text, the 
various combinations of population, 
and sample size will be 
represented symbolically in the fol- 
form: E(O, 1)5-N(O, 4)15. 
Here the letters E, N, and R refer to 
the population from which the sam- 
ple was drawn, E for exponential- 


Variance 


lowing 
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Fic. 1. Empirical distribution of t's from 
N(O, 1)5-N(O, 1)5 and 
tion with 8 df 


theoretical distribu- 


N for normal, and R for rectangular. 
The first number in the parenthesis is 
the mean of the population distribu- 
tion, in all zero, while the 
second number is the variance. The 
number following the parenthesis is 
the sample size for that particular 
sample. 
first sample is of Size 5 from an ex- 
ponential! distribution having a vari- 
ance of 1. The second sample is from 


Cases 


In the example above, the 


a normal distribution with variance 
of 4 and the sample size is 15 


Sampling from Normal Distributions 

In order to justify the random 
sampling approach utilized in this 
study, and partly to the 
faith placed in the tabled values of 
the mathematical the 
initial comparisons are between the 
theoretical distributions and the ob- 
tained distributions with assumptions 
inviolate. ) 


conftiirm 


Statisticians, 


Figures 1 and 2 exhibit 
the empirical distributions of t's when 
both samples are taken from the same 
normal distribution with zero mean 
and unit variance N(0, 
1). In Fig. 1 both samples are of 
Size 5, while both are 15 in Fig. 2. 
The theoretical curves, one for 8 df, 
the other for 28, represent quite well 
the obtained distributions. Ordi- 
nates approximately two units from 
the mean of the theoretical distribu- 
tions mark off the respective 5% lim- 


designated 


its for rejecting the null hypothesis 
In Fig. 1,° 5.3% of the obtained t's 
fall outside these bounds, while in 
Fig. 2 only 4.0% of the sample t's 
are in excess. Since in both cases 
the exper ted value is exactly 5° ln, we 
must attribute the discrepancy to 
The 
size of these discrepancies should be 
evaluating the 
discrepancies which will be encoun- 


random sampling fluctuations. 


useful measures in 
tered under other conditions of sam- 
pling. For examples of 2000 t's a dis 
crepancy from the 
value evidently occurs 
frequently, and for this reason should 


as large as 1% 
nominal 5% 


not be considered as evidence to re 
ject the theoretical distribution as an 
approximation to the empirical one 

As an initial departure from the 
simplest cases just presented, Fig. 3 
compares theoretical and empirical 
distributions when samples are taken 
from N(0, 1) population, 
but the first sample size is 5, the sec- 
that is, N(0, 1)5-N(0, 1)15. 


While this in no sense is a violation 


the same 
ond iS 15 


of the assumptions of the ¢ test, it 1s 
interesting to note that again sam- 
pling fluctuations have produced an 
empirical distribution with 4.0% of 
the t's falling outside the nominal 5% 
limits 


* The numbers in the tails of some of the 
figures report the number of obtained ('s [all- 


ing outside the boundaries 
‘ 


Fic. 2. Empirical distribution of t's from 
N(O, 1)15-N(O, 1)15 and theoretical distribu- 
tion with 28 df 
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The violation of the assumption of 
homogeneity of variance has effects as 
depicted in Fig. 4. Here the ob 
tained distribution is based upon 
two samples of Size 5, one fror 
N(0, 1) and the other from N(0, 4 
The fit is again seen to be close be 
tween theoretical and empirical dis- 
tributions, and 6.4% of the obtained 
t's exceed the theoretical 5% limits 
$y increasing the sample size to 15, 
a distribution results (not shown here 
for which only 4.9% of the t's fall 
outside the nominal limits. It would 
seem that in reasing the sample siz 
produces a distribution which con 
forms rather closely the ¢ distri- 
As will be seen late r, this is a 
result 


bution 


quite general based upol 
mathematical co siderations, the im 
plications of which are important to 
the argument 
evident that variance 
at least in the ratio of 1 to 4 do not 


seriously affect the accuracy of prob- 


For the moment it is 
differences in 


ability statements made on the basis 
of the ¢ test. 


This last conclusion is true only so 


long as the size of both samples is the 

If the varian 
the 
there are two combin 


same. 
with 


*s are different, 
present set of conditions 
itions o! vari- 
ance and sample size possible In 
one case the first sample may be of 
Size 5 and drawn from the popula- 


tion with the smaller variance, while 


Fic. 3. Empirical distribution of ) 
N(O, 1)5-N(O, 1)15 and theoretical distribu 
tion with 18 df. 
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Se ane eee anita aoe 
5 : | 
mut ot 


4. Empirical distribution of t's from 
5-N(O, 4)5 and theoretical distribu- 
tion with 8 df 


the second sample of Size 15 is 
drawn from the population having 
the variance—N(0, 1)5-N(0, 
4)15. In the second case the small 
sample SIZE 1S « oupled with the larger 
variance, the larger sample size with 
the smaller variance—N(0, 4)5-N(0, 
1)15. The respective results of such 
sampling are presented in Fig. 5 and 
6. The empirical distributions are 
clearly not approximated by the ¢ 
For the distribution 
only 1% of the obtained 
the nominal 5% values, 
while in Fig. 6, 16% of the #’'s fall 
outside those limits. 

There are good mathematical rea- 
sons why a difference in sample size 
should produce such decided dis- 
crepancies when the variances are un- 
Recall that 2(X — M)*/(N—1) 


is an estimate of the variance of the 


larger 


distribution. 
ol Fig. 5, 


t's exceed 


equal 





Fic. 5. Empirical distribution of ¢’s from 
N(O, 1)5-N(O, 4)15 and theoretical distribu- 
tion with 18 df 
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Fic. 6. Empirical distribution of ¢’s from 
(N(O, 4)5-N(O, 1)15 and theoretical distribu- 
tion with 18 df. 


population from which the sample is 
drawn. Hence, >(X — M)? will in the 
long run be equal to (V—1)¢*. The 
formula used in this study for com- 
puting ¢ makes use of this fact and, 
in addition, under the assumption 
that the variances of the populations 
from which the two are 
drawn are equal, pools the sum of the 
squared deviations from the respec- 
tive sample means to get a better 
estimate. That 2(X,—M,;)? 
+2(X:—M:)? is an estimate of 
(Ni —1)0;?+(N2—1)o2?. Hf o,2?=0;? 
=o" (homogeneity of variance), then 
the sums estimate (N,+N,—2)o? 
Hence, 


samples 


1S 


is an estimate of o?. If o,2?+o,* the 
estimating procedure is patently il- 
legitimate, the resulting value de- 
pending in a large measure upon the 
combination of sample size and vari- 
ance used. For example, the case 
N(0, 1)5-N(0,4)15 has N, =5, N,=15, 
o,7=1, o,2=4, and N,+N,—2=18. 
With these values, Formula 1 has 
an expected value of [(4-1)+(14-4)] 
/18=3.33. Using the appropriate 
values for the other situation, N(0, 
4)5-N(0, 1)15, the result of formula 
1 is [(4-4)+(14-1)]/18=1.67. This 
means that on the average, the de- 
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nominator for the ¢ test will be larger 
for the first case than for the second. 
If the sample differences between 
means were of the same magnitude 
for the two cases, obviously more 
“significant’’ t's would emerge when 
the denominator is smaller. It 
happens that when this latter condi 
tion exists, the variance of the numer- 
ator to be greater than 
in the other condition, a fact which 
accentuates the differences between 


SO 


also tends 


the two empirical distributions. 

Welch (1937 
matically that in the case of sample 
sizes of 5 and 15, a state which pre 


has shown mathe- 


vails here, the percentage of t's ex 
ceeding the nominal 5° value varies 
as a function of the ratio of the two 
population variances and can be as 
low as 0% and as high as 31.3% 
If N, = N, there is never much bias, 
except perhaps in the case in which 
the sample sizes are both 2. For 
N,=N;=10, the expected value of 


the percentage of t's exceeding the 


t 
5 


nominal 5°; limits varies between 
and 6.5% 
between 


regardless of the difference 
the For larger 
sample sizes, the discrepancy tends 


variances. 


to be even less 

Since the pooling procedure for esti 
mating the population variance is 
analysis of variance 
would that the 
combination of unequal variances and 
might play 
havoc with F test probability state 
That of 
large variance and large sample size 
d to make the F test more 
conservative than the nominal value 


used in ordinary 
techniques, it seem 


unequal sample sizes 


ments is, a combination 


should tet 


would lead one to expect, and, as 
with the ¢ test, small variance and 
large sample size should produce a 
higher of 


These conclusions 


percentage “significant” 
Fs than exper ted 
are based upon a very simple exten- 
sion to more than two samples of the 


explanation for the behavior of the 
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t test probabilities with unequal sam- 
ple sizes. 

A more sophisticated mathematical 
handling of the problem by Box 
(1954a) reaches much the same cor 
clusions for the simple-randomized 
In a table in his 
athe 


analysis of variance 
article are 
matically 


of exceeding the 5 por 


exact 


determined 


given 


ances are unequal In t 


sampling is assumed to be fr 
mal distributions If the 


sizes are the same, the probabil 


or equal Sal ple 


irom $50 to 7 $2° 


given sizes 
combinations of varian 

bers of sa nple 5 

are different, the 

ent 
the nominal values result 


§1z¢s, large 

Combining 
large sample and large variat 

ens the probability of obtaining 
“significant” result t 
5%, just as we have seen 
test in 
(1954b 


two-way 


a subsequent 
presents son 
analysis of varia 
these designs generally ha 


cell 


too tar 


frequencies the results 
from expected His 
ull run within 2% of the 5% 
expected if all assumptions were 1 
that 


and mathematically 


It would seem then both em 


pirically there 


can be demonstrated onl) 1 minor 


effect on the validity of prob 


ibility 


statements caused by heterogeneity 


lad the eiz f +} 
ied the sizes ot the 


ry! 


‘ il ies 
If how 


the sample 7 : » different, 


ol variance, provi 
the same This 


{ test 


samples are 
to the F as well as the 
ever, 
major errorsinu 

sult if normal curve 


Sampling from Identical 
Distributions: (Equal Var 


Let us now proceed to violate the 
other main assumption, that of nor 


mality of distribution from which 
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sampling takes place. At this time 
we will consider the ¢ distributions 
arising when both samples are taken 
from the same non-normal distribu- 

he distributions shown here, 
and all subsequent ones, are based 
upon only 1000 #’s, and hence will 

somewhat more column to 
column fluctuation than the preced- 


ing distributions 


exhibit 


Figure 7 compares the theoretical 
t distribution and the empirical dis- 
tribution obtained from two samples 
of Size 5 from the exponential distri- 
bution—E(0, 1)5-E(0, 1)5. The fit 
is fairly close, but the proportion of 
the tails seems less for the 

distribution than for the 
By count, 3.1% of the 
obtained t's exceed the nominal 5% 
values—that is, the test in this case 
seems slightly conservative. If both 
sample sizes are raised to 15 (distri- 
bution shown here), the corre- 
sponding percentage of obtained ?'s is 
4.0%. While this is probably not an 
appreciably better fit than for sam- 
ples of Size 5, we shall see later that 
there 


cases 1 
empirical 


theoretical. 


not 


ire theoretical reasons to sus- 
pect that increasing the sample size 
should better the approximation of 
the empirical curve by the theoretical 
no matter what the parent popula- 
tion may be 

f both samples are of Size 5 from 
me rectangular distribution 


1)5—the result is as 


wut ot 


Fic. 7. Empirical distribution of t's from 
E(0, 1)5-E(O, 1)5 and theoretical distribu- 
tion with 8 df. 
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depicted in Fig. 8. The fit of theoreti- 
cal curve to empirical data here is as 
good as any thus far observed. The 
percentage of obtained t's exceeding 
the 5% values is 5.1% in this particu- 
lar case. For the case in which the 
sample sizes are both 15 
here), the fit is equally good, with 
5.0% of the cases falling outside of the 
nominal 5°; bounds. 


not shown 


Sampling from Non-Normal Distribu- 
tions: (Unequal Variances 


We may assume that if the vari- 
ances are unequal, and at the same 
time the sample sizes are different, 
the resulting distributions from non- 
normal populations will be affected 
in the same way as the distributions 
derived from normal 
and for the same reasons 
will not be considered 

If sampling is in sizes of 5 from 
two exponential distributions, one 
with a variance of 1, and the other of 
4, a skewed distribution of obtained 
t's emerges shown here We 
shall discover that a skewed distri- 
bution of ?’s generally arises when 
the sampling is from distributions 
which are different in degree of skew- 
ness or asymmetry. 
tion, see of E(0, 1 
N(O, 1)5 Apparently, the 
effect of increasing the \v 


populations, 


These cases 


not 


(For an explana- 
discussion )5- 
below 
iriance of 
the exponential distribution as in the 
present case—FE(0, 1)5-E(0, 4)5 


18 


to make the negative sample means 


arising from the distribution with 
larger variance even more negative 
than those from the distribution with 
smaller variance. In terms of per- 
centage exceeding the nominal 5% 
limits for this case, the value is 8.3%, 
of which 7.6°% comes from the skewed 
tail. This combination of variances 
and distribution was not tested with 
larger samples, but we shall see when 
comparing exponential and normal 
distributions that an increase in the 
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Fic. 8. Empirical distribution of t's from 
R(O, 1)5-R(O, 1)5 
tion with 8 df 


and theoretical’ distribu 


‘ 


sample size decreases the skew of the 
Theo- 


retically, this decrease should occur 


obtained ¢ distribution there 


in almost all cases, including the pres 
ent one 

The result 
cated if, variances are differ- 
ent, the sampling is from symmetrical 
rectangular -R(O, 1 
R(0, 4)5. For this small sample situ- 
ation, (not illustrated), there oc« 


is much less compli- 
while 


distributions 


urs 
a distribution of obtained t's having 
7.1% of the the 
nominal 5° This is roughly 
the 


sponding discrepancy 


values exceeding 
points 
same magnitude as the corre- 
from: normal 

For the normal, it will 
that the 
sample sizes to 15 decreased the ob 
tained to 4.9%. There 
is no reason to believe that increasing 


distributions 


be ret illed an increase of 


percentage 


ot 


not 


the size the rectangular samples 
the effect 
However, time did not permit the de 
termi! 


would have same 


1iton of this distribution. 


Sampling from Two Different Distri 
butions 


By drawing the first sample from 


a distribution having one shape, 
and by drawing the second from a 
distribution having another shape 
(other than shape differences arising 
yet 
another way has been found to do 


violence to the integrity of the as- 


from heterogeneity of variance), 
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sumptions underlying the ¢ test. Per 
haps the least violent of these hap 
penings is that in which at least one 
of the populations is normal 

When one sample is from the ex 
ponential distribution and the other 
from the normal, the interesting re 
sult shown in Fig. 9 occurs 
the small sample case E(O, 1)5 
N(O,1)5 It 
for skewed 


This is 


that 
distributions the mean 
different 
In the exponential distributions, for 


will be recalled 


and median are at 


points 
example, the mean is at the 63rd ce 
tile 


distribution are small 


If samples from the exponential 


. there will be i 
tendency for the sample mean to be 
less than the population me 

ously since nearly two 

scores are below that mean 

the population mean of the 
distributions is 0, the result will be 
preponderance of negative sam 
If the ott 


sample is taken from a symi 


means for small samples 


eric; 
distribution, which would tend 
produce as many positive as | 


sample means, the resulting d 

tion of obtained t's would not 

about its zero point, an imbalance ex 
acerbated by small samples. In Fig 
9, 7.1% of the obtained cases fall out 
side the 5“, limits, with most, 5.6°, 
lhe effect of 
increasing the sample size to 15 is to 
normalize the distribution 


ably; 


lying in the skewed tail 


( onsidet 


the resulting curve, Fig. 10, is 


Fic. 9 Empiri« al 
E(0, 1)5-N(O, 1)5 
tion with 8 df. 


dietribut 


and theoretical 
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Fic. 10. Empirical distribution of ?’s from 
E(0, 1)15-N(O, 1)15 and theoretical distribu- 
tion with 28 df 


fairly well approximated by the ¢ dis- 
tribution. One of the tails, however, 
does contain a disproportionate share 
of the cases, 4.2% to 0.9% for the 
tail, or a total of 5.1% falling 
the nominal 5% limits. Nev- 
ertheless, the degree to which the 
theoretical and empirical distribu- 
tions coincide under these conditions 
It seems likely that if 


other 


| 
outside 


is striking 


i 
both samples were each of Size 25 


the resulting sample distribution of 
t's would be virtually indistinguish- 
ible from the ¢ distribution for 48 df, 
or the next best thing, the normal 
curve itself. To test this hypothesis, 
in additional empirical ¢ distribution 
based on sample sizes of 25 from these 
same exponential and normal popula- 
tions was obtained (not shown here). 
he results nicely confirm the pre- 
with the 
4.6% ol 
the empirical t's surpassing them. 
Whereas with the smaller samples the 
ratio of t's in the skewed tail to those 
in the other tail is roughly 80:20, the 
for the larger 
sample case is 59:41. Clearly, the in- 
crease in sample sizes has tended to 
normalize the distribution of ?'s. 
For 


sumption. Comparison 


> values 


1 ef¢ 
usual 9o 


reveals 


corresponding ratio 


involving 
rather drastic violation of the mathe- 
matical assumptions of the test, the 
, 


t test has been observed to fare well 
with an adequate sample size. Such 


these conditions, 
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a state of affairs is to be expected 
theoretically. By invoking a few 
theorems of mathematical statistics 
it can be shown that if one samples 
from any two populations for which 
the Central Limit Theorem holds, 
(almost any population that a psy- 
chologist might be confronted with), 
no matter what the variances may be, 
the use of equal sample sizes insures 
that the resulting distribution of ?¢’s 
will approach normality as a limit. 
It would appear from the present re- 
sults that the approach to normality 
is rather rapid, since samples of sizes 
of 15 are generally sufficient to undo 
most of the damage inflicted by vio- 
lation of assumptions. Only in ex- 
treme cases, such as the last which 
involves differing in 
skew, would it seem that slightly 
larger sizes are prescribed. Thus it 
would appear that the ¢ test is func- 
tionally a distribution-free test, pro- 
viding the sample sizes are sufficient- 
ly large (say, 30, for extreme viola- 
tions) and equal. 

The distributions when 
sampling is from the normal and the 
rectangular distributions—wN(0, 1)5- 
R(O, 1)5 and N(O, 1)15-R(O, 1)15 
—would further tend to substantiate 
this claim. 


distributions 


arising 


The respective percent- 
ages exceeding the 5% nominal 
values are 5.6% and 4.6% from 
the empirical distributions for these 
cases, the distributions of t's being 
symmetrical and close to the theo- 
retical (not shown). 

The only other combination exam- 
ined in the sampling study is the un- 
interesting case of exponential and 
rectangular distributions. This dis- 
tribution (not shown) is again skewed 
with the effect of increase of sample 


size from 5 to 15 to cut down the 


skew and to decrease the percentage 
of cases falling outside the theoretical 


5% values from 6.4% to 5.6%. For 
those cases falling outside the nomi- 


nal 5% values, the ratio is 79:21 for 
the smaller samples. This is changed 
to 69:31 for the sample size of 15 
Here again it would seem that larger 
sample sizes would be required to in- 
sure the validity of probability state- 
ments utilizing the ¢ distribution as 
a model. 

The results of the total study are 
summarized in Table 1 which gives 
for each combination of population, 
variance, and sample size (a) the per- 
centage of obtained ¢'s falling outside 
the nominal 5% probability limits of 
the ordinary ¢ distribution, and (bd) 
the percentage of obtained f¢'s falling 
outside the 1% limits. The combina- 
tions are represented symbolically as 
before. The table is divided into two 
parts, the first part presenting infor 
mation on the empirical distributions 
which are intrinsically symmetrical 
The second part is based upon the in- 
trinsically nonsymmetrical distribu- 
tions, additional information in this 
section of the table being the percent- 
age of obtained t's falling in the larger 
of the tails. The percentage for the 
smaller tail may be obtained by sub- 
traction of the percentage in the larg- 
er tail from the total. 

Certain implications of the table 
In the Norton 
study, more severe distortions some 


should be discussed. 


times occurred with significance lev 
els of 1% and .1% than appeared 
with the 5% level. The inclusion in 
Table 1 of the percentages of ob 
tained t's falling outside the nominal 
1% values makes possible the com- 
parison of the 1% and 5% results 
The 1% values seem to be approxi 
mately what would be expected con- 
sidering that sampling fluctuations 
are occurring. It was not felt feasible 
to determine the results for the .1% 
level since with only 1000 or 2000 
cases the number of obtained f's fall- 
ing outside the prescribed limits was 
negligible in most cases. It is pos- 
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sible, however, that the distortions in 
the apparent level of significance are 
more drastic for the smaller a values 
All the results 
have limited 
two-tailed { test 
the have 
reached can be applied directly to the 
one-tailed f 
ceptions 
which 


and discussion 
thus far to the 


With notable ex- 


conclusions we 


been 


ceptions, 


The ex 
those distributions 


test as well 
involve 
are intrinsically a 
Table 1 


a preponderance of the obtained f's 
fall in one tail 


ymmetr i 

(see In these distributions 

De pending upon the 
: | 

particular tail involved in the one 

tailed test the use of t should produce 

too too 


many ofr lew significant re 


TABLE 1 


OBTAINED PERCEN 
OUTSIDE THE APPROPRIATE TABLED { 
VALUES FOR THE 5% AND 1% Level 
OF Si 


TAGES OF CASES FALLING 


+NIFICANCI 


Obta 


ANAS 


n 


Distributions 
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sults when sampling is from a combi- 
nation of populations from which an 
asymmetric ¢ distribution is expected. 
It seems impossible to make any 
simple statements about the behav- 
ior of the tails in the general case of 
asymmetric ¢ distribution except to 
say that such distributions are ex- 
pected whenever the skew of the two 
parent populations is different. The 
experimenter must determine for 
each particular instance the direction 
of skew of the expected distribution 
and act accordingly. Table 1 gives 
for the intrinsically asymmetric dis- 
tributions the tota! percentage of ob- 
tained t's falling outside the theo- 
retical 5% and 1% limits and the per- 
centage in the larger tail. From 
these values can be assessed the ap- 
proximate magnitude of the bias in- 
curred when a one-tailed test is used 
in specific situations. 


DisCUSSION AND CONCLUSIONS 


Having violated a number of as- 
sumptions underlying the ¢ test, and 
finding that, by and large, such vio- 
lations produce a minimal effect on 
the distribution of t's, we must con- 
clude that the ¢ test is a remarkably 
robust test in the technical sense of 
the word. This term was introduced 
by Box (1953) to characterize sta- 
tistical tests which are only inconse- 
quentially affected by a violation of 
the underlying assumptions. Every 
statistical test is in part a test of the 
issumptions upon which it is based. 
For example, the null hypothesis of a 
particular test may be 
with sample means. 


concerned 
If, however, the 
issumptions underlying the test are 
not met, the result may be “ 
cant” 


signifi- 
even though the population 
the same. If the statisti- 
is relatively insensitive to 
violations of the assumptions other 
than the null hypothesis, and, hence, 
if probability statements refer pri- 


means are 
cal test 
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marily to the null hypotheses, it is 
said to be robust. The ¢ and F tests 
apparently possess this quality to a 
high degree. 

In this particular context, an im- 
portant example of a test lacking 
robustness is Bartlett's test for 
homogeneity of variance (Bartlett, 
1937). Box (1953) has shown that 
this test is extremely 
non-normality and will 
conditions be prone to yield “‘signifi- 
cant” even if are 
equal. For example, Box tables a 
number of exact probabilities of ex- 
ceeding the 5% 


sensitive to 
under some 


results Variances 


normal theory 
the Bartlett 
for various levels of Xo, 


sig- 


nificance level in test 


the kurtosis 
parameter, for different quantities of 
1. 


As an ex- 
treme A2=2 (i.e., a peaked 
distribution) with 30 variances being 
tested, the probability of 
the hypothesis at the nominal .05 
level is actually .849. If A, 1 (i.e., 
a flat distribution), the probability is 
.00001. Note that in both 


cases, all variances are 


variances bei: g compares 


case, 11 


rejecting 


these 
actually 
equal. Box, realizing that in the case 
of equal sample sizes the analysis of 
variance is affected surprisingly little 
by heterogeneous variance and non- 
normality, concludes that the use of 
the nonrobust Bartlett test to ‘‘make 
the preliminary test on variances is 
rather like putting 
rowing boat to find out whether con- 


out to s@a ina 
ditions are sufficiently calm for an 
ocean liner to leave port \ppar- 
ently, as reported in this same arti- 


cle, other commonly used tests for 


evaluating homogeneity are subject 
to the same weakness 

We may conclude that for a large 
number of different 
fronting the researcher, the use of 
the ordinary ¢ test and its associated 
table will result in probability ite- 
ments which are accurate to a high 
degree, even though the assumptions 


Situations con- 
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of homogeneity of variance and nor- 
mality of the underlying distribu- 
tions are untenable. This large num- 
ber of situations has the following 
general characteristics: (a) the two 
sample sizes are equal or nearly so, 
(6) the assumed underlying popula- 
are of the 

(If the distribu 
they should have 
the same variance If these 
conditions are met, then no matter 
the 


be. samples ol 


tion distributions same 
shape or nearly so 
tions are skewed 
nearly 
what variance differences may 
as small as five wil! 
produce results for which the true 
probability of rejecting the null hy- 
the .05 level will more 
than likely be within .03 of that level 


If the sample size is as large as 15, 


pothesis at 


the true probabilities are quite likely 
within .01 of the 

That is to the 
times the null hypothesis will be re 


nominal value 


say, percentage ol 
jected when it is actually true will 
tend to be between 4°% and 6% when 
the nominal value is 5% 
sample sizes are unequal, 
o difficulty provided the 
are compensatingly equal 
nation of unequal sample 
nequal variances, how 
matically produc es inaccu 
rate which 


probability statements 


can be quite different from the nomi 
nal values. One must in this case re 


sort to different testing procedures, 
Cochran and Cox 
(1950 Satterthwaite (1946 and 


Welch (1947). The Welch procedure 


is interesting since it 


such is those by 


has been ex 
tended by Welch (1951) to cover the 
simple randomized analysis of var 

ance which suffers the same defect as 
the ¢ test when confronted with both 
unequal variance and unequal sam 
ple sizes. The Fisher-Behrens pro 
cedure suggested by many psycholog 
textbooks 
has had its validity questioned (Bart- 


lett, 1936 


ically orients statistical 


and, hence, is ignored by 
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some statisticians (e 


Bancroft, 1952, p. 82 


* 


If the two underlying populations 


are not the same shape, 
to be little difficulty if the distrib 


tions are both symmetrical 


s 


differ in skew, however, the distribu 
s has a te 
self to be skewed. hav 


percentage of obtained t's 


tion of obtained ¢ 


side of one limit than the 
may tend to hias probal 
ments Increasin 
has the effect of ret 
and, due to the Cer 
rem and others, the 
tion 1s approat hed by 
By the time the 

25 or 30, the apy 
enough that or 

the effects of \ 
tions except for extre 


is SO the 


1951 
guarat 
uniformly 


1 
possible 
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of the distribution-free methods are 

more powerful than the ¢ and F tests 

when sampling is from some unspeci- 

fied distributions or combination of 

distributions. At present, little can 

be said to clarify the situation. Much 

ore research in this area needs to be 
hone 

Since the ¢t and F tests of analysis 

variance are intimately related, it 

an be shown that many of the state- 

ments referring to the ¢ test can be 

‘neralized quite readily to the F 

In particular, the necessity for 

ual sample sizes, if variances are 

il, is important for the same 

s in the F test of analysis of 

e as in the ¢ test. A number 

cited have demon- 

strated both mathematically and by 

eans of sampling studies that most 


articles 


statements we have made do 
to the F test 


psychological 


It is suggested 
researchers feel 
utilize these powerful tech- 
here applicable in a wid- 

of situations, the pres- 
ent emphasis on the nonparametric 


methods notwithstanding. 
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yracuse { 


ol 


psy hologists 


Since the advent 


hniques, 


projec tive 


nave 
to the r 


ce 


te 


voted considerable energy re 


ation and utilization of v us meth 
the ‘‘de« per 


ari 
ods for assessing layers’ 
with 


ments have led to 


impressive ! 


ol personality 


often obtained these 
methods 


thu 


projective 
are greeted with « 
dated by endorse: 
incritical accept 
testing produced 
mainly concerned \ 

popula 


notics, al 


istics of such cli 


delinquents, psy 
In general, the assumpt 


ics 
made that a 


minded 


projective tft 
single 
1939 
about 


as 
reve alin “4 
the 


way being infl 


patier 
i¢t 
who administer 
od of admit ist 

in which it was 1 
h (1956 
dominates 


that the test 


( ronbac 
been 
view 
subject's response 
I onpersonal stim 
histica 


However, with growing s 


tion regarding the nz sycho 


logical testing, a 1 nber writers 
the in 


tors 


have explicitly commented o1 
fluence in projective testing of fa 
ther than the S's personality One 
of the to delineate the 
jective factors in Rorschach 
Schactel (1945 


common ele men 


first sub 
testing 
described 


in the 


was who 


Ror 


four ts 
schach situation 
the E and S; 


task by the £ to the 


the relationship of 
the 


the assignment of 
S; the E's need 
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neiversiy 


to it S’s behavior; and 
the specific qualities of the task, such 
biguity or the lack of fa- 
miliarity the stimuli. Miller 
1953), Sarason (1954), and Luchins 
1947) have also indicated the subtle 
ways in which subjective forces may 
influence the course of a projective 


iterpret the 


is the am 


with 


testing situation, 
It is the purpose of this paper to 
the considerable evidence re- 
ng situational and interpersonal 
rojective testing. Ex- 
with the effects of 


' 
periments dealing 
these factors on interviewing or in- 
testing and those studies 
the effects of psy hother- 
psychosurgery, individual 
ip tests will not be reviewed, 
to 
ff essentially different prob- 


Higence 


ncerniny 


and 


these issues are considered 
part 
ms Four arbitrary, overlapping 
will be to 
nethod of administra 


itegories used 


present 
the st studies 
the testing situation, examiner 


e, and subject influence 


INFLUENCI METHOD 
OF ADMINISTRATION 


DH oO} 


Instructions to make a good or bad 


impression. The ability of projective 


by Ss 


“real”’ re- 


withstand attempts 
alter their 


been 


ise 


or 


sponses has investigated sev 


he usual procedure in 
the same Ss 


eral times 
these studies is to test 
several times under varying instruc- 
tions; comparisons are then made be- 
tween the test responses produced un- 


der standard instructions with those 


y ielded 


by experimental instructions. 
Fosberg (1938, 1941, 1943) has re- 
ported on the process of trying to 


65 
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produce a good or bad impression on 
the Rorschach 
berg, 1938) a husband and wife were 
each administeréd the Rorschach 
under four sets of instructions. De- 
spite the instructions to create a 
given impression, it concluded 
that the Ss unable to 
revealing basi 


In one study Fos- 


was 


were avoid 


aspects of their per- 
sonality, the psychograms on the 
examinations 
the same In a later 
berg, 1941 . the Rors« hach w 
four times different 


tions to 25 male and 25 female Ss 


four 
essentially 
Fos 


sgiven 


remaining 


stud. 


under instruc- 


A special experimental group of 16 


Ss took the fourth examinat 


der instructions to look for par 


When Fosberg 


group means produced 


determinants 
pared 
the different instructions 
few consistent differences 
little change the 

only the content 
showing marked ch: 

for the failure of thes« 
produce differences 

that each S defined for 
manner in which to decei 
that six Ss incre 

in order to mak a good 
while four 


ised thei 
' 


in order to make 
While 


among all Ss on 


oor mpression 
p ) ipre 1oO 


there was no consistency 
how to cre ite 
artificial image for the / most 
felt that they could falsify their re 
tions by adopting i parti ular set 
special importance to this 
the fact that in trying 
impression several Ss seen 
centrate on the &£, 
test; three Ss ar 
acted stubborn and ornery, 
ceeded very slowly, and four 
little attention (Fosberg, 1943 
Fosberg’s studies were essentially 
repeated by Carp and Shavzin (1950) 
who also found that taking the Ror- 
schach under instructions to make a 


review 


rather 
noved the 
two pro- 


paid 
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good impression (‘‘you are in a state 
hospital and the results on this test 
may help get you out’’) and under 
instructions to make a bad impres 
to be drafted for the 
this test 
produce no 
significant group differences (except 
for the z score, significant at the .05 
level “This 


sion (‘‘you are 
Army the 


may help keep you out” 


and results on 


does not mean, how 
ever, that 


rhe 


ences Bi 


no changes were produced 


data clearly showed the differ 
it the direction taken was so 
imong the individual Ss, 
the 


The authors di 


were balanced out in 
>?» 


p E32 


h iller ged 


that the 


losberg’s conclu 
Rorschach could not 
the Ss “On 
this study 


ulated by 
shows that 
ne subjects who can ma 
responses, who can 
| 

their personality picture as re- 
by the 
s t< 


Rorschach, under in- 
make bad’ 
impressions’ (p, 233 

Weisskopf and Dieppa (1951) ad 
the TAT 
to hospitalized psychoneurotic vet 


the standard 


‘yood’ or 


ministered three cards of 


instruc 
t linistration, asking the 
t possible impre s 


mn on another administration and 


the worst possible i Ipression on the 


third nistration Ot 
dimensions rated by 
iticant 


the I! 


the 


judges, 


nine 
five 
differences as a 
When 


give their worst im 


structions 


were rated as less 
more hostile, less will- 
and more sponta 

us Wallon and Webb (1957) 
asked naval aviation cadets to take 
the Rosenzweig P-] 
tence completion test under several 
variations of 


contorn 


test and 


a sen 
and test 
One group took the P-F 
multiple 
took it in 


instructions 
structure, 
choice form, 


standard 


test in i 


another form, 
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while a third group was told intaking other determinants (F%, FM, m, 
the test to try to make the best im- Hd, Ad) as well, although there were 
pression. It was concluded that as no significant differences between 
the test became less ambiguous, the groups on the first test. Evidently es- 
results more closely resembled re tablishing a set for area will also af- 
sponses produced under instructions fect those determinants dependent 
to fake upon the area of the blot. The evi- 
Instructions emphasizing particular dence of Keyes (1954) also supported 
determinants or locations. |n the proc the notion that the number of whole 
ess of studying suggestibility, Coffin responses can be influenced by special 
(1941) demonstrated how S's set may instructions 
influence his responses to the Ror Hutt, Gibby, Milton, and Pott- 
schach test. The Ss were first asked harst (1950) and Gibby (1951) in- 
to read a fictitious article by a ' ited the effects of instructing 
vard professor’ describing how pro : to pay particular attention to 
fessional men usually saw whol peci aspects of the Rorschach 
sponses, while business n sa\ ble 1 each study various parts of 
mals, skilled laborers saw inanim ts were emphasized to the 
objects and WPA emplo saw ¢ Ss a the standard administra- 
tails A second gro SI n ym of the test, but prior to the ex- 
article that nov ib prot perimental administrations. A study 
sional men as seei! ils, | 1es of t-retest reliability of the Ror- 
men inanimate objects, et llov hach under these conditions showed 
ing the reading of this articl ’ certain determinants to be more 
S was administered six Rorschach able and less resistant to change 
cards. The results clearly show h than others. ‘‘What appears to be 
influence of the suggestion on the 1 crucial is how the individual per- 
sponses, each group tend Oot s the total test situation. If we 
spond in the same directior th lo not know this, we are likely to 
socially acceptable norn ppa make serious errors in interpreta- 
ently the suggestion sets up a « i¢ p. 185 
mining tendency operating upon After first administering the Ror- 
observer's perceptual a maginal schach under standard instructions, 
processes. This acted to direct tl ibrikant (1954), in his instructions 
é '" (p. 62 to the experimental group, stressed 
a better mtrolled = stt vement, color, shading, and tex- 
Abramson (1951) e l two gi s ture responses. In the experimental 


I 
of college students o1 ; iS Ol group, 15 Ss showed differences be- 


W, D, and Dd responses tl irs tw first and second administra- 
administratior . hach tions in at least 3 of the 4 response 
One group ol Os Vv n told that categories, while in the control group 
successful business and professional only 3 Ss showed significant changes 
men saw whole i s, while the it least 3 categories. 

second group wi nstru i t Instructions regarding the purpose 
these men saw detail respor ling The most impressive 
consequence of the differe } dence regarding the effects of tell- 
structions, the two groups dif ng the S the purpose of the test- 
significantly on the seco! rschach ing comes from the study of Henry 
test not only in the number of whe and Rotter (1956), who simply told 
and detail responses but on several their experimental group of female 
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undergraduates what college 
students have already presumably 
learned about the Rorschach test 
from television, the movies, and 
Life magazine: “This is a test to 
discover serious emotional disturb- 
ances."’ It was found that the experi- 
mental group gave fewer responses 
(at the .01 
responses (.05 level), more popular 


most 


level), more good form 


responses (.05 level) and more animal 
responses (.05 level) than a control 
group given a standard administra- 
tion. It was evident that making 
explicit the purpose of the test pro- 
duced more more 
attempts to be safe than leaving the 
purpose unstated 

A study by Calden 
(1953 
both 
tions 


constriction and 


and Cohen 


investigated the influence of 
instruc- 
the 


senior 


ego involvement and 
regarding the nature of 
Rorschach test Half thet 
high school Ss were given’ ego-in- 
volving instructions and half were 
given neutral instructions; one-third 
of the Ss were told that Ror 
schach tested another 
third that it 
and the last group that it measured 
imagination. An 
computed for 27 
showed 19 differences sigr 
the .05 level 
personality 
from the 
tions resembled the same constricted, 
safe picture found by and 
Rotter, form and responses 
increasing, 


the 

intelligence, 
tested ‘‘nervousness,”’ 
analysis of variance 

selec ted \ iriables 
luncant at 
In general, the re sulting 
that 


pattern emerged 


intelligence test instruc- 
Henry 
anim il 
movement responses de- 
‘‘Needless to say, predic- 
tions based on ‘blind’ interpretations 


creasing 


of the Rorschach protocol, without 


knowledge of the testing situation or 
the S's reactions to the testi: yg, 
so much 
in the light of 
study” (p. 308-9 

The TAT 


study the 


are 
viewed 
this 


more fallible when 
the results of 
has also been used to 


effects of informing Ss 


of the purpose of the test (Sum- 
merwell, Campbell, & Sarason, 1958). 
Four different groups were used, each 
group receiving one of the following 
instructions regarding the purpose of 
the test: (a) the usual Murray in 
structions, (6) intelligence test in- 
projective test in- 
structions, (d) neutral instructions 
found that the neutral in- 
structions produced significantly dif- 


structions, (¢) 
It was 


ferent emotionally toned stories than 
any of the other three groups, with 
story outcomes significantly different 
from Murray 
tions and the projective test instruc- 


the standard instruc 


tions 
The 


spon é In 


manipulation of time of re 
the group Ror 
to 10 Ss under conditions of 
long time exposure (3 min.) and short 
(10 Weisskop!{ 
1942) noted that the same person 
ality pattern both 
conditions of Un 
itely, adequate experimental 
controls were not employed. A more 


giving 
be | h ici 
time exposure sec.). 
emerged under 


administration. 
fortur 


rigorous procedure was utilized by 
Siupola and Taylor (1952) who gave 
the Rorschach test to experimental 
Ss seated in front of a noisy auto 
matic timer which recorded reaction 
the first response. It 
concluded that the pressure induced 
by the resulted in 


time ot was 


timer normal Ss 
behaving under stress much as dis 
turbed patients do in a 
‘The moral of all 
seems to be that the 


nonstress 
this 
projective pro 


situation 


ess, like any other psychological proc 
ess, is not immune to the influences of 
the specific conditions under which it 
operates” (p 46 


[HE INFLUENCE OF THI 
TESTING SITUATION 


Che designs for the studies investi- 
gating the effects of varying testing 
conditions take several forms. The 
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most rigorous of these utilizes a con- 
trol group that has been given two 
administrations of the test to 
trast with the experimental group 
which had experienced the special 
conditions between the first 
second testing. If the projective test 


con- 


and 


permits, some investigators prefer to 
counterbalance the order of presenta- 
tion of the particular cards used 


necessitating at least two experimen 
tal groups and two control groups 
Another frequent 
utilize a 


design does not 


control group,.the only 
comparison made being that of the 
first administration of the test with 
the second 


differences between 


administration, with all 
administrations 
assumed to be a function of the inter- 
vening conditions. A third procedure 
consists of administering a single test 
to groups known to differ on a par 
ticular dimension; all differences in 
test results are then attributed to the 
central, identifiable difference be 
tween the groups. 

The 
matic effort to induce stress was that 
of Lindzey (1950a, 1950b), who frus- 
trated his experimental Ss by sub 
jecting them to 10-12 hours of food 
deprivation, inducing them to drink 
and ther 


urinating tor 


Stress. most careful, syste 


a large quantity of water 


preventing them from 
approximately three hours, taking a 
blood sample in a painful way with 
a spring lancet, and by forcing them 
to fail in a As a 


consequence of these conditions the 


group situation 
Rosenzweig Picture Frustration Test 
showed a significant increase in 
extra-punitive (Lindzey, 
1950b). Of 12 predictions regarding 
changes in the TAT, 11 were in the 
with 5 hypo- 
the .05 level of 
confidence or better (Lindzey & Her- 
man, 1955). The effects of stress on 
the Rosenzweig P-F test 
studied by French (1950 


responses 


expected direction, 


theses confirmed at 


were also 


Ww ho gave 


students in a social psychology class 
erroneous grades on an examination. 
Half the students who earned an A or 
B were given C or D, while half 
those earning a C or D were given an 
A or B. On the P-F test given im- 
mediately after the grades were re- 
turned the good students given the 
poor grades (the stress group) did 
not differ from the good students who 
were assigned their correct grades. 
However, the poor students given 
the erroneously high grades showed 
fewer intropunitive ego-defensive re- 
sponses than the poor students given 
their correct grade. 

Eichler (1951) used an elaborate 
device resembling an electric chair to 
his Ss while taking the Ror- 
schach. They were made to wear a 
helmet which looked as if it could 
conduct electricity and were told 
that while taking the test they would 
be given shock, ‘‘the longer the time 
interval that elapses without the 
receipt of shock the more intense 
the next shock will be.’ On the basis 
of an administration of the Behn- 
test, the experimental 
group was matched on five variables 
with a control group that took the 
Rorschach under standard 
conditions. Judges who made a blind 
global rating of the Rorschach proto- 
cols found a significant difference in 
anxiety between the two groups. On 
15 anxiety indicators, however, they 
found that only 4 reflected a signifi- 
cant difference between groups while 
3 additional variables did not reach 
statistical significance but were in 
the predicted direction. 

Less dramatic forms of frustration 
seem also to be effective in demon- 
strating how projective devices may 
reflect pretest conditions. Crandall’s 

1951) experimental Ss took tests of 
physical skills between administra- 
tions of the TAT and were informed 
that they had not meet the ‘‘norm.”’ 


seat 


Rorschach 


second 
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A control group rested between test 
administrations. As a result of the 
failure situation the experimental Ss’ 
expectation for punishment as re- 
vealed in the TAT increased signifi- 
cantly. 

Schwartz and 
posed stress by giving their Ss a 
fictitious ‘“‘interpretation” of their 
Rorschach or Behn-Rorschach re- 
sponses, showing them to be poorly 
adjusted. When the second test was 
administered only 2 (FC and RT) of 
16 preselected Rorschach variables 
showed differences as a 
function of the stress 


Kates (1957) im- 


significant 


The best adjusted and most poorly 


adjusted NYA 
were made to fail in performing with 
the Rotter Level of Aspiration Board 
The pre- and TAT 
records of the two groups differed in 
several ways, 


members of camp 


postirustration 
the poorly adjusted 
group showing a decrease in themes of 
superiority, and 
(Rodnick & Klebanoff, 


aggression, emo- 
tional states 
1942). 
Three studies did not impose stress 
experimentally, but utilized Ss in 
“natural” stress conditions. Klatskin 
(1952) gave the Rorschach test to one 
group of patients the day before they 
were to receive gynecological surgery 
and to another group of patients the 
day before they 
charged from the obstetrical service 
The hospital patients were matched 


were to be dis 


on age and intelligence with a group 
of clerks. Of the 65 
made between groups, 21 significant 
differences were found, generally in- 
dicating 
more self preoccupation in the hos- 
pitalized Ss. In study 
which utilized hospitalized Ss, Meyer, 
Brown, and Levine (1955) found that 
H-T-P drawings secured before sur- 
gery indicated far 
than was apparent either clini 


comparisons 


greater constriction and 


another 


more regression 
ally or 


‘The 


in the postoperative drawings 
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contrast between the pre- and post- 
operative drawings were often so ar- 
resting as to cast doubt upon their 
being the product of the same indi- 
431 Abel (1953), how 
found conflicting patterns in 


vidual’ (p 
ever, 
human figure drawings in patients op- 
erated on for correction of facial dis- 
Some 
great ¢ hanges in drawings as a result 
others 
little change, while still a third group 


figurement patients made 


ol corrective surgery, made 
made dramatic changes in drawings 


even though no surgery had been 
performed 

Bellak (1944) made the stressful 
conditions part of the TAT test ad- 
ministration by 


criticizing (‘These 


stories are about the worst I've ever 
heard” et« the S's efforts halfway 
through the testing session. He found 
that 


marks were characterized by an in- 


the stories following these re- 
ise in aggressive words. Unfortu 
tely, a control gruup was not used 
Drug The 


variety of drugs have been studied by 


effects of a wide 


means of projective devices, particu 
While there is 


1 of a Rorschach being given 


larly the Rors« hach 
no recor 
under water, there are reports of 
Rorschachs given under the influence 
alc ohol, 


of mescaline, sodium amytal, 


hyoscine, morphine, and oxygen de- 
privation In general, these condi 
tions produced limited effects on the 
test records. Sodium amytal seemed 
to make Ss willing to co 
the 
1947 


responses seemed less bizarre, 


more 
operate in taking Rors hach 


Wilkins & Adams, 
quent 


and subse 


permitting more detailed descriptions 
Kelly, Levine, Pem- 

1941) When 
through a mask, 
reached a simulated altitude of 16,000 
ft., their Rorschachs showed the same 


ol personality 
berton, & 
Ss, given 


Katz, 
oxygen 


basic pattern as tests given under 


standard conditions, except for a 


decrease movement responses and 
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an increase in color responses (Hertz- 
& Seitz, 1942 
and color responses showed striking 
the 
(,uttman, 
1932 


Rorschach 


man Movement 


changes when the S was under 
influence of mescaline 
1936). Werthman and Bleuler 
have reported that the 
test given under mescaline corre 
sponded more closely to the person 
than the 


The y also re 


ality as known in life 


standard Rorschach 
ported the considerable difficulty 
holding the experimental S to the task 
wher 
ittend his 


idministration of 


of attending to the Rorschach 
he seemed to prefer 
own images I he 
hvyoscine toan S afflicted with enceph 
alitis produced inconsistent changes 


lange 
1947 


} these expe riments 


in the Rorschach (Cofer, 
While most Ss | 
were badgered, frustrated and other 


wise treated unpleasantly, in three 


studies Ss were served liquor 
return for taking a project 
between 9—15 


bourbor 


In one investigation, 


ounces of 100 proof were 
served between administra 
the | he concl 


the experiment support the unsystem 


Rors« h ic h 


whe 


the 


atic observations of drinkers 


have to buy their ov inder 
influence of alcohol, 
ception, attention to 


critical attitudes and sel 


attitudes decrease (Rabu 


& McMichael, 1954 »t 


the TAT 


Rorschach 


1942 
Kelle & Berrera 


agree that projective responses giver 


Tromp} ins, 


when the S 1s intoxicated 
de t iils but do not 


inv consistent nm 


n minor 
lanner iron 
given when sober 

Whether 


subjected to 1 


Brown's (1943) Ss were 
oxious or pleasant test 
difficult 
to make, since he 


phine to 22 


conditions is a distinction 


administered mor 
postaddict patients who 
had previously been abstinent from 
the drug for a 


minimum of six 
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months. If the Ss did not experi- 
the “right feeling’’ from the 
first experimental injection, the dose 
was increased until a euphoric state 
was reached. It was reported that 
intellectual control, originality, and 
organizational energy were not af- 
fected by morphine, but there was a 
shifting to greater imaginative living. 
There was no report on subsequent 
ttitudes by the Ss toward the drug 
or this particular method of admin- 
istering the Rorschach. 

Hypnosts The use of hypnosis 
with resistant test Ss was reported 
by Wilkins and Adams (1947) who 
found that this method produced co- 
operation and a useful test record. 
One 5S, studied intensively by hav- 
different induced 
while under hypnosis, was variously 


y seven moods 
nstructed that she was grief stricken, 
undi- 
ignosed illness, depressed, carrying on 
in extramarital affair, etc. While the 
content of the Rorschach tests given 
mmediately after the instructions 
changed from role to role, the sim- 
larity 


euphoric, concerned about an 


between records was great 


enough to show that the same under- 
lying personality was being observed 
Levine, Grassi, & 1943, 
1944 \ similar procedure was em- 
ployed by Sarbin (1939) who told his 


Sin one hypnotic session that she was 


Gerson: 


Madame Curie and in another session 
that she was Mae West. A third 
Rorschach given while the S 
was under hypnosis without any spe- 
It was found that 
S tended to adopt the set im- 
posed by the hypnotic instructions, 
so that half of her responses in the 


was 


; 
cine 


suggestion 


the 


Madame Curie instructions concerned 
while two thirds of 
the Mae 


sisted of clothing 


her re- 
West set 
and 
The control Rorschach, 
given in the waking state, contained 
only two responses found in the hyp- 


science 
sponses in con- 
costume as- 


sociations 
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notic trance states. Hypnosis has 
also been used to study age regression 
(Bergmann, Graham, & Leavitt, 
1947). The test responses of a 20- 
year-old S, given the Rorschach for 
the eight alternate years between 3 
and 20, seemed to reflect the various 
stages in the development of his per- 
sonality. 

Two studies used the Rorschach 
with Ss who had been instructed un- 
der hypnosis to feel hostile toward 
the examiner (Counts & Mensh, 1950; 
Pattie, 1954). To illustrate the diff- 
culties involved in using hypnosis for 
this purpose, the conclusions in one 
study were different from those in the 
other. Counts and Mensh (1950) 
found that the hostility to the E 
which appeared during the psychi- 
atric interview was not reflected in the 
Rorschach, while Pattie (1954) could 
divide his 14 Ss into 3 
of which (N= 
increase in hostile content in the 
posthypnotic Rorschach. The num- 
ber of white space responses did not 
increase under the hostile instruc- 
tions. A considerable degree of indi- 
vidual differences was also found by 
Arluck and Balinsky (1953) who 
used as the hypnotic suggestion ‘‘you 
are mature, warm 
etc. For some Ss the responses on 
both the 
completion test showed numerous dif- 
ferences with prehypnotic test rec- 
ords, but for others the two sessions 


groups, 


two-fold 


one 
8) showed a 


and outgoing,” 


Rorschach and a sentence 


produced highly similar results 
Qualitative and quantitative dif- 
ferences following the hypnotic in- 
duction of and a 
despondent mood were found on a 
word association test (Fisher & Mar- 
row, 1934). The reactions times were 
longest for unpleasantly toned words 
and were fastest for neutral words. 
Special training and experience. 
Several experiments 
gated the 


an elated mood 


have investi- 


influence of perceptual 
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training upon Rorschach scores. 
Knopf (1954) provided pre-Ror- 
schach perceptual training in find- 
ing animal or animal parts for one 
group of Ss while the second group 
watched a film on the nature of color. 
He concluded that the over-all pic 

ture of the personality remained bas- 
ically unchanged. Kurtz and Riggs 
(1954) similarly found no differences 
in group Rorschach scores in Ss who 
had first been exposed to a visual set 
“So far as this 
study is concerned, Rorschach work- 
ers remain secure in the assumption 
that implicit peripheral sets will not 
influence test results to any appreci- 
able extent’ (p. 469). Nor did Nor- 
man, Leverant, and Redlo (1952) 
find that Rorschach scores were al- 
tered by having one group of Ss first 
look at colored food ads while another 


to perceive animals. 


group looked at pictures of people in 
motion Evidence that perceptual 
training can influence Rorschach per- 
formance has been reported by Keyes 
(1954) and Leventhal (1956). Sub- 
jects trained on stimuli similar to the 
Street Gestalt pictures produced an 
increase in the number of whole re- 
the group 

Training on the Gott- 


sponses on Rors hac h 


(Keves, 1954 
schaldt figures before an administra- 
tion of the group Rorschach resulted 
in lower W and Z scores (Leventhal, 
1956) 

Giving children a “gratifying” ex- 
penience prior to 
improve performance on the Draw 
A-Person test (Reichenberg-Hackett, 
1953 (1947) showed a 
neutrally toned film to children the 
evening before they took the second 
half of the TAT. Of the 370 stories 
told after the film only one clearly re- 
flected the content of the film. Kim- 
ble (1945) gave the Rorschach test 
twice, once in the standard office pro- 


testing seemed to 


Coleman 


cedure and once in the college cafe- 


terias with at least two other people 
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present. The test results were quite 
similar in the two situations, the 
most important difference occurring 
in the experience balance, more color 
responses being given in the social 
situation. Gibby, Stotsky, and Miller 
(1954) concluded that the experience 
of taking a psychological test (Ben- 
der-Gestalt, TAT, Wechsler-Belle- 
vue, or Goldstein-Scheerer) 
ately before an administration of the 
Rorschach did not alter any of 11 se- 
lected Rorschach variables 
Deprivation or arousal of needs 
The effects of hunger on associations 


immedi- 


to ambiguous stimuli have received 
the attention of three investigators 
School children showed more food as- 
sociations on a word association test 
shortly before a regular meal than on 
San 


who 


the test given after the meal 
ford, 1936) 
had fasted for 24 hours before tak- 


Undergraduates 
ing five projective tests gave more 
food responses than did Ss who had 
for 


abstained from food shorter pe 


riods of time. The increase was not a 
straight line function of time, how- 
ever, the most hungry Ss giving only 
slightly food responses thar 
the groups examined near the end 
of a normal eating cycle (Sanford, 
1937) Atkinson and McClelland 
(1948) were able to food 
score on TAT stories that could dif- 
ferentiate reliably among groups de- 
prived of food for 1, 4, or 16 hours 
While there was no increase in food 


more 


derive a 


imagery in these stories, there was a 
marked increase in food deprivation 


themes. While the TAT may be able 


to reflect a state of food deprivation 


the report of Franklin and Brozek 
(1949) indicated that the Rosenzweig 
P-F test responses ofa group of con 
scientious objectors did not change 
significantly from a period of semi 
starvation to a state of nutritional re 
habilitation 

studies the el 


lwo investigated 
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fects of motor inhibition on the pro- 
duction of movement responses in 
the Rorschach test. Korchin, Meltz- 
off, and Singer (1951) restricted nor- 
mal motor behavior in their Ss by 
having them write a standard phrase 
as slowly as possible. Singer, Meltz- 
off, and Goldman (1952) reduced the 
motor behavior of Ss by requesting 
them to stand for five minutes with- 
out moving. In each experiment, the 
Ss denied motor activity gave more 
movement responses than a control 
group. However, Singer et al. (1952) 
also found that increasing motor be- 
havior (by having Ss engage in five 
minutes of vigorous calisthenics) did 
not reduce the number of movement 
responses 

rhe relationship of experimentally 
aroused needs on projective test re- 
sponses has also been investigated. 
When the need for achievement was 
induced by means of ego-involving 
instructions, stories of college men 
achievement imagery 
themes and themes of instrumental 
acts and attitudes related to achieve- 
ment (McClelland, Clark, Roby, & 
Atkinson, 1949). The stories told by 
high school boys to pictures of male 
figures also showed an increased num- 
ber of themes related to achievement 
as a result of special achievement 
arousing conditions. These achieve- 
ment arousing conditions, however, 
were not effective in increasing 
achievement themes of either high 
school girls or college girls (Veroff, 
Wilcox, & Atkinson, 1953). 

A sociometric test given prior 
to the administration of the TAT 
seemed to increase themes related to 
the affiliation motive (Shipley & Ver- 
off, 1952; Atkinson, Heyns, & Veroff, 
1953). Freshmen who were rejected 
for membership in a fraternity gave 
more affiliation themes on the TAT 
than students who were accepted into 
fraternities (Shipley & Veroff, 1952). 


in reased in 
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Clark (1952) attempted to raise the 
level of sexual motivation by show- 
ing Ss slides of nude females before 
administering the TAT. A control 
group was shown slides of landscapes. 
Under these the group 
shown the slides of the nudes gave 
fewer manifest sexual responses and 
fewer themes of guilt than the con- 
trol Ss. However, when the experi- 
ment after all the Ss 
had participated in a beer party, the 


conditions 


was repeated 


experimental group gave more stories 
of manifest sex and guilt than those 
Ss who had been shown the landscape 
slides. Nelson, and Clark 
(1954) had one group of undergradu- 
ate males waiting to take the Ror- 
schach 

orated 

surgical 
somewhat 

assignment 
tions, was seated in a 


Rabin, 


test ren dec- 
with 


pictures; a 


ain in a room 
charts and 
group, 


their 


anatomical 
second 
more tortunate in 
to experimental condi- 
room deco- 
rated with photographs of nude and 
seminude females; the control group 
waited in an 


While there 


tween groups in the number of anato- 


undecorated room. 


was no difference be- 
my responses, there was a significant 
difference in the number of sexual re- 


sponses. 


THE INFLUENCE OF THE EXAMINER 


While the evidence regarding situ- 


ational factors in projective testing 


has been compiled over the years, 
the studies dealing with interpersonal 
influences is of rather recent origin 
Guilford’s 1947 study was the first in 
this area and it was three vears be- 
fore the next re- 
ported. The relative neglect of this 
problem was not entirely due to lack 
of awareness of its importance, since 
McFarlane (1942) wrote that ‘‘inter- 
pretation in the hands of the clin- 
ically inexperienced, the doctrinaire, 
or the methodologically 
easily degenerates into nothing more 


experiments were 


uninformed 
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but one more predictive tool 
which the organizing 
dynamics of the interpreter rather 
than the organizing dynamics of the 
research subject"’ (p. 405), and Joel 
1949) that “even if it were 
possible for the examiner always ac 

tually to feel the way he pretends he 


to wit, 


one disk loses 


warned 


does, we should not forget that the 
subject reacts not only to the exami 
ner’s real attitude, but also to what 
he thinks the examiner's attitude is’’ 
p 480 
rents to exploration of this question 
the that the 
E influence struck at the heart of 
the X-ray concept of projective tests 


Probably the greatest deter 


were facts notion ol 


and the extreme complexity and sub 
tlety of the interpersonal testing situ 
ation, so aptly discussed by Schafer 
(1954 
cult 
The the hy 
pothesis that Hs would differ in the 
elicited Ss by 
irom 


made experimentation difh 


first studies tested 


they from 


test 


responses 
analvzing records secured 
the files of 
to determining which characteristics 


ol Es 


iclinic. As interest turned 


were related to differences in 
Ss’ responses, such physical attributes 
of £s as skin color, size, and sex were 
well 


investigated, as as personality 


variables revealed in psychological 
the Rorschach The 
‘and S§ been 
se veral 
by cor trolling the 
sion or by 
with & 


with & 


tests, generally, 


interaction of E has 


studied o1 occasions, either 
warm-cold dimen 


taken 
taken 


contrasting tests 


present with those 
ibsent 

A completels caifferent approat h to 
this problem is through the use of 
hypnosis. While no study used hyp- 
the 


testing relationship, most of the ex- 


nosis primarily to investigate 
periments using hypnosis do report 
that S's test varied with 
the hyp: Thus far 
only two 1959; Wick 


es, 1956) attempted to establish oper 


behavior 
otic suggestion 


tudies Gross, 
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ant conditioning of S’s verbal 
ior, but this method seems s 
ing that undoubtedly it 
more widely used in i 
aminer influence 

l he examiner 
fics The most 
characteristics of the 
color, scx, and body build 
these attributes has bee 
ior possible il f] 1e@1 
sponses Three st 
sex of & 
Rorschach test Alce 
1951 selected 100 
ords trom the 1 
all test Ss wer 
te sted b 

ale The 


ferences if 


to sexual 


il responses that 
the sex ol J 
ry results were 
ind Wolf (1951 
Rorschach recor 
comparisons were I 
ind covert sexual 
386 Ss to three ten 
is Statistically 
ences were obta 
1954) found th 
of & mak 
Phe 
, } 


1 room des Oral 


charts did no 


of anatomu 
male and female 
Ss who h 
rated 
vave Ssignilica 
sponses to the 
female. Clark 
os wave more 
sponses and I 
the TAT toa 
tractive, rather 
The influence 
Draw Person 


and sex ot produc 


tions were investigated by Holtzman 
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1952) who found that none of his 12 
judges could guess better than chance 
either the sex or the identity of the 
Es by inspecting the drawings of 40 

and 40 female Ss. 

} one of whom was nearly a foot 


taller and 60 pounds heavier than the 


Two male 


other, and two female Es differing in 
degree of feminine qualities,’ were 
used Garfield, Blek, and Melker 
1952) used two female and two male 
Es to administer the TAT to 54 male 
ind 56 female Ss.. Neither the sex of 
E nor the interaction of the sex 
and S produced significant dif- 
rences in the stories 
Riess, Schwartz. and Cottingham 
1950) investigated the responses ol 
o and white Ss to Negro and 
- stimulus figures on TAT cards 
nistered by a Negro and white 
d concluded that skin color of 
did not affect the length of 
While most investigators 
for the influence of the £& in 
Rankin 


nd Campbell (1955) used as their 


’ 


verbalized test responses, 
ndent variable the galvanic skin 
mse of male Ss to a Negro and 
E. Tn a word association situa- 
the & checked and adjusted on 
occasions dummy equipment 
ected to S's left wrist. It was 
| that there was a higher differ- 
galvanic skin response to the 


‘ al 
Negro £, but since he was 9 years 
ler, 24 inches taller and 27 pounds 
r than the white #, there was 
mclusive proof that the differe 

e was a function of skin color. 


Presence or absence of examiner 


from the testing room Bernstein 
1956) found that i AT stories writ- 
the absence of the £ more fre- 
quently contained sad themes, sad 
outcomes, and showed greater S in- 
than written 
with the & present in the testing room. 
aspects of H-T-P drawings 


secured from applicants for employ- 


volvement stories 


Certain 
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ment at a state school were found to 
be a function of the E's presence when 
the test was taken. Total size of the 
drawing, house size, house features, 
and person features all differed sig- 
nificantly between the group taking 
the test with E present and the group 
taking the test with the E 
(Cassel, Johnson, & Burns, 1958 
Van Krevelen (1954b) tested 20 Ss 
with 2 cards of the MAPS series; one 
story dictated to her 
other was written in her 
The only significant difference be- 
tween the two groups was that the 
more ambiguous of the two cards 
produced more words in the written, 
E-absent situation. The absence of 
the E seemed to have effect 
on Szondi test results (Van Krevelen, 
1954a). 
ministered the Szondi by the E and 
at other times took the test them- 
selves. When E nt, Ss 
showed greater consistency, demon- 
strated more plus-minus reactions, 
and had a greater surn of open and 
plus-minus reactions than when £E 
was present 

Warm-Cold examiner behavior. Luft 
(1953) varied the interaction between 
Eand S by acting warm and friendly 
to some Ss and cold and blunt 
others. The cold interaction con- 
sisted of asking the Ss their social 
security number and draft status and 
by giving a short quiz on current 
events (e.g., ‘“Which horse won the 
Kentucky Derby?’’) before adminis- 
tering 10 homemade ink blots. When 
the Ss were asked which inkblots they 
liked and which they disliked, the 
group treated in the warm fashion in- 
dicated that they liked a mean of 7.¢ 
blots, while the cold Ss liked only a 
mean of 3.1 blots, a difference signifi- 
cant beyond the .001 level. Lord 
(1950) used three styles of adminis- 
tering the Rorschach 
tive, and negative 


absent 


was and the 


absence. 


more 


The Ss were sometimes ad- 


was abse 


to 


neutral, posi- 
and three female 
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Es. In the positive interaction E was 
instructed to look at S with a smile 
and to be warm and charming; the 
negative interaction called for E to 
assume the role of a harsh, demand- 
ing, authoritative hgure, deliberately 
unconcerned about S. Each S took 
the Rorschach three times with the 
order of E 
terbalanced 


and administration coun- 

As a result of the dif- 
ferent methods of interaction, the 
eheited from the warm 
administration produced more re- 
sponses, more evidence of intellectual 


protoc ols 


and creative imagination, less indica- 
tion of sterotyped thinking and in- 
creased evidence of greater ease in 
In the cold 
responses indicating 
imaginative, creative thinking were 


reduced, there appeared to be a with- 


interpersonal relations. 
administration, 


drawal from emotional stimuli and 


there was a rise in self-questioning 
feelings 
Operant 


conditioning of subject's 


verbal behavior. Two studies investi- 
gated the extent to which S's associ- 
ations to 
mined by 
(1956 


ink blots could be deter- 
Wickes 
used 30 homemade inkblots, 
two £s, and 36 undergraduate Ss di- 


the E's behavior. 


vided into two experimental groups 
and one control group 


In one ex- 
perimental group the first 15 cards 
were given in the standard manner; 
with Card 16 the E to 
the first movement response, ‘“‘good,” 
the second 
and “‘all right” 
ment 


said, ‘“‘fine,”’ 
to movement response, 
to the third 
making 


move- 


response these com- 
ments in regular sequence to the end 
of the ting In the ex- 
perimental group the first 15 cards 
were given 


Card 


tes second 
in standard fashion, but 
16 the E made various 
postural and gestural changes, nod- 
ding his head three times to the first 
movement response, smiling on the 


with 


next movement response and leaning 
forward in the chair after the third 
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movement response, repeating this 
sequence to the end of the testing 
When the responses on the first 15 
and second 15 cards were compared 
for all groups, it was found that the 
experimental group given verbal re- 
inforcement made a significant in- 
movement re- 


half of the 


crease (.025 level) in 


sponses on the second 


test, the experimental group given 


postural reinforcement made a sig- 
nificant increase (.005 level) in move- 
ment responses in the second half of 
the test, while there was no difference 
in the number of movement re 
sponses in the control group. Gross 
(1959) verbally 
one group of Ss tor eac h human re 
the 


a second group he nodded his head 


reinforced good’ 


sponse on Rorschach while for 
once following each human response 
Both the verbally group 
and the nonverbally reinforced group 


produced 


reinforced 


human 
than a control group. 


more responses 

The effect of the examiner as a 
on: no asses per- 
sonality. In a report not seen by the 
writer, but quoted by Lord (1950 
and others, (1947 
concluded that some Es elicited more 


/ . 
per 


ment of examiner 


Guilford con- 
responses from their Ss in administer- 
ing the Rorschach test than other Es 
1951 


tain Es seemed to produce more re- 


Baughman also noted that cer- 
sponses in selected Rorschach cate- 
He selected 633 
protocols secured by 15 Es from the 


gories than other Es. 


files of a veteran's outpatient clinic, 
and found 12 of 22 scoring categories 
differing significantly at the .001 level, 
with four additional differences sig- 
nificant at the .05 level Unfortu 
nately, the protocols were not scored 
by the investigator, so that the differ- 
ences found may have resulted from 
the psychologists’ procedures in scor 
ifiluence 


and Bern 
two Es in 


ing, rather than from their i 
on S. Both Wickes (1956 


stein (1956) used thei 
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studies and each concluded that the 
psychologists did not exert any sig- 
nificant influence on the Ss’ responses. 

To control for some of the sources 
of variation in responding to the Ror- 
schach, Gibby (1952) had 9 Es use a 
standardized inquiry in testing 135 
Ss. Despite this, significant differ- 
ences in responses were found for 6 
of the 11 determinants investigated. 
‘The stimulus value of. the examiner 
therefore must be considered a factor 
which influences the inquiry re- 
sponses of the subject and therefore 
the final Rorschach psychogram. 
Standardization of the inquiry does 
not eliminate examiner differences” 
p. 452). An attempt was made by 
Gibby, Miller, and Walker (1953) to 
secure a homogeneous group of pa- 
tients whose Rorschach records could 
be analyzed for E influence. All Ss 
used were male veterans, white, 25-— 
32 years old, had functional rather 
than organic ailments, and were the 
most patients tested by E. 
All 12 Es whose records were ana- 
lyzed had a minimum of two years 
experience, used Beck's Rorschach 
method and had tested at least 20 
Ss who met the criteria for the study. 
All protocols were coded and scored 
blindly. 


recent 


Of the nine absolute scores 
which were investigated, three were 
significant at the .05 level or better, 
and of the & percentage scores, 3 
were significant at the .05 level or 
better. The investigators concluded 
that ‘‘there are significant over-all 
differences in the determinants ob- 
various examiners from 
comparable groups of subjects. ... 
It is also probable that certain ex- 
aminers tend to obtain successively 
dysphoric records while others with 
comparable patients will seldom elicit 
such reactions” (p. 426). 

Robinson and Cohen (1954) exam- 
ined the case reports prepared by 
three psychological interns. The last 


tained by 
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30 reports for each of the three in- 
terns were examined for the variables 
of dependence, independence, aggres- 
sion, and abasement. When the inci- 
dence of these variables in the case 
reports was compared for each of 
the three psychologists, 6 of the 12 
comparisons were significant at the 
.OS level. When components of 
these variables were considered, 12 
of the 24 comparisons were signifi- 
cant at the .05 level of confidence 


The investigators concluded that 


this study raises ‘‘a serious question 


about the objectivity of methods of 
evaluation and prediction if they 
must rely solely upon psychological 
reports for their basis’’ (p. 335 

The effect of the examiner as a per 
son; examiner's personality assessed 
Hammer and Piotrowski (1953 
asked three staff psychologists and 
three interns to rate 400 H-T-P draw- 
ings on a 3-point scale of aggression 
The clinicians were themselves rated 
by one of the investigators on the de- 
gree of aggression and hostility they 
manifested in dealing with patients 
and staff members. In addition, the 
clinicians also took the Szondi 
which was scored by Susan Deri for 
degree of hostile and aggressive im- 
pulses. A rank order correlation of 
.94 was found for the degree of hos- 
tility the clinicians saw in the H-T-P 
productions and the evaluation made 
of their interpersonal hostility. The 
rating of the clinicians’ Szondi tests 


test 


also yielded a rank order correlation 
of .94 with their evaluations of the 
hostility in the H-T-P. The authors 
concluded that “just as a subject's 
performance on a projective tech- 
nique is a function of his personality, 
his needs, conflicts, desires and past 
experiences, so too, although to a les- 
ser degree, is the interpretation of a 
projective protocol influenced by the 
personality pattern of the interpre- 


ter’’ (p. 214-215). Filer (1952) ana- 
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lyzed 156 case reports submitted by 
13 male clinicians for references to 
hostility, hostility turned inward, 
passive dependency, and feelings of 
also 


inferiority Evaluations were 


obtained of the clinician's behavior 
in terms of ascendency, depression, 
intropunitiveness, extrapunitiveness, 


and impunitiveness. The results indi- 


cated a omplex relationship between 
the judgments of the clinician and 
the judgments made by the clinician 
For example, Es 
tility 
pressed and intrapunitive. 


who stressed hos 
inward were rated de 
A sepa 
to defense 
isms indicated that the three 
frequently 


turned 


rate study of references 
mechar 
mech- 


most mentioned 


anisms were more characteristic of 
E than the test S 

Berger (1954) used the personal 
Rorschach results of eight VA train 
ees to compare with the Rorschach 
records these #s elicited from VA pa 
tients. (Contrary to the findings of 
most other studies, Berger found no 


significant differences in E influence 
on 12 variables in the patients’ Ror 
However, when both the & 


and his Ss were rank-ordered on the 


sé hac hs 


12 variables, a rho correlation of .86 
as found for the number of popular 
‘sponses, a rho of .80 for white space 
sponses and a rho of —.54 for Y 

‘sponses 


Lord did attempt to 
make a formal assessment of the per 


1950 not 
sonalities of her three female Es, but 
she obtained descriptions of them at 
a subjective, intuitive level from two 
clinicians, relating these descriptions 
to the Rorschach responses secured 
from Ss. The first #, described by 
the judges as a cold, inflexible, mas 
culine, castrating woman, produced 
Rorschachs from her Ss that made it 
appear that they had faced a threat 
situation. rhe 
second £, described as the most femi 
the the 


ening, trustrating 


nine of group, softest and 





VARIABLES IN 


most mother-like, elicited Rorschach 
that had 
under 


records suggested her Ss 


been controlled excitement 
without great anxiety or tension and 
had not be« 


tellectually 


n greatly stimulated 
The third / 


est of the three and was described as 


was the old 


the most flexible, exuberant, sympa 
thetic, intermediate in fer 

Her Ss’ Rorschach records sug 
gested that they had been challenged 


but there was 


ities 


ind made anxious, 11SO 
evidence of easy rf ipport and a rela 


tive absence of controlling devices 


Ihe TAT and MMPI 


nine ks were evaluated ind 


records 


pared with the Rorschach 
the Es had elicited \ 

kk variance showed 22 
Rors hach variables 5 
the 


ers, Ww 


05 level or Detter Vi 


Cleveland 1950 


and Cleveland 1953 tra 


second year ur iduate stucke 
minister the Rorschach test 
obtaining a personal Kors 
After a | 
i administered 20 R 
s it 


each riod of tr 
dergraduate 
testing sessior 

ik on measures 
hostility Indicat 
anxiety and ‘hostilit 
by rating their per 


When 


yivel 


records 
sponses 
constant it W 
20 variables 

significantly ar 
high on overt 
elicited more 


Spat e respons } nore 


sponses than those rated low 
No differences 


could be accounted for by 


anxiety 


the Es on 
rated 


covert anxi 
high on hostility 
elicited greater Y' 
Rorschachs they 


: , 
secured less hostile 
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tent than those Es whose Ss rated 
them low in hostility. The Ss’ reac- 
tion times seemed slower when FE was 
perceived as hostile, a finding in 
agreement with the observation made 
of the test behavior of Ss with hyp- 
notically induced hostility to E 
Counts & Mensh, 1950; Pattie, 
1954 When £s’ personal Ror- 
schachs were examined for hostility, 
it was found that the more hostile Es 
elicited less Y%, less A%, more hos- 
tile content and more human content 
than those Es with low covert hos- 
tility The authors concluded that 

Che this study provide 


evidence that a subject's responses 


esults of 


on the Rorschach test are not solely a 
product of his own emotional prob- 
lems and personality structure’’ (p. 
+s While the investigators clearly 

licated that E as a person can in- 
test results, they 
vated that the extent of this influ- 
account for only 3—-7% of 
the total variance in the Rorschach 


luence the esti- 
e can 


scores 


[HE INFLUENCE OF THE SUBJECT 
While 


agreement 


there is wide theoretical 
that party in the 
testing situation exerts an influence 
on the other, the experimental evi- 
dence is limited almost entirely to the 
t & has on S Perhaps the chief 
reason for the failure to investigate 
anner in which S can influence 


each 


the n 
the psychologist is the lack of tradi- 

yal experimental procedures that 

1 afford control of the S’s behavior 
while the £’s behavior is allowed to 
vary The one study in this area 
Masling, 1957) S's be- 
havior by using attractive female ac- 


coritrolled 


complices who posed as test Ss, act- 
ing warm or cold to E. The de- 
pendent variable was the interpreta- 
tion placed on sentence completion 
protocols by eight graduate student 
Es. It was found that when S acted 
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warm to E her protocol was inter- 
preted more favorably (i.e., she was 
seen in better mental health) than 
when she acted cold. In addition, 
the results indicated that when E 
saw two Ss, one of whom was cold 
and the other warm, the protocol of 
the warm S was interpreted more 
favorably than that of the cold S. 


DISCUSSION 


The studies presented in this paper 
have been reviewed rather uncrit- 
ically, with the emphasis on content 
rather than on adequacy of experi- 
mental design. Since faulty experi- 
mental procedures appear with regu- 
larity in the studies in this area, it 
might be worthwhile to examine 
more closely the more commonly 
found limitations in design: 

1. No study reviewed here exten- 
sively sampled the E population. As 
Hammond (1954) has indicated, rep- 
resentative design demands that both 
E and S populations be adequately 
sampled if generalizations are to be 
made to larger groups of S and E. 
Most studies cited here, however, 
utilized only one E, with only Baugh- 
man (1951) using as many as 15 Es, 
The general results of the work on E 
differences makes clear how tenuous 
it is to assume that one E is drawn 
from the same population as any 
other E. 

2. Not only has the E population 
been inadequately sampled, but the 
little attention given to Es has been 
directed for the most part to grad- 
uate students. While it is legitimate 
to work with a graduate student 
population it is inappropriate to gen- 
eralize findings to a population of 
older, more experienced Es. 

3. Those studies which investi- 
gated the influence of E differences 
by utilizing a random sample of cases 
found in the files of a clinic, make the 
assumption as Levy (1956) has indi- 


cated, that the cases were originally 
assigned on a random kasis. This as- 
sumption may not always be valid, 
due to differences in E schedules, in- 
terests, and competence. As a result, 
differences in test records may be in 
part a function of uncontrolled bias 
It is far better 
procedure for the investigator to con- 
trol the assignment of cases than to 
assume existing cases had been ran- 
domly assigned 


in the selection of Ss. 


4. A frequent method of assessing 
E personality has been to ask the E£ 
As the 
review make quite 
clear, the orientation S has toward 
the test considerably influences his 
responses. Few graduate students in 
psychology are naive regarding the 
more common projective tests, even 
if they have never seen them before 
The Rorschach 
taken by a graduate student, there- 
fore, is unclear and cannot be easily 
related to differences in Ss’ responses 
A better way of evaluating E's per- 
sonality might 


to take a psychological test. 


results of this 


meaning of a test 


be to obtain judg- 
ments by his supervisors and col- 
leagues. Another method that shows 
promise is that used by Sanders and 
Cleveland (1953), who asked the test 
Ss to make ratings of their impres- 
sions of £ 


5. Most investigations of suscepti 
bility of Ss’ responses to situational 
influence have been conducted em- 
pirically, with no prior attempt made 
to predict where differences would be 


found. Research on the Rorschach 
has been particularly culpable in this 
regard. Since the Rorschach is still 
primarily an empirically, rather than 
theoretically, based instrument, most 
investigators have attempted to de- 
termine only if differences would oc- 
cur between experimental and con- 
trol groups, but, on finding differ- 
ences, have been unable to interpret 
their meaning. As a result of this ap- 
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proach, almost every Rorschach score 
has at one time or another been found 
to be a function of some experimen- 
tal variable: Z, W, W%, Ds, D, Dd%, 
F—, F+%, F% FM, m, M, CF, C, 
Y, Y%, A, A%, P, R, reaction time 
and experience balance have all been 
reported to change as a result of ex- 
perimental conditions 

6. Many of the Rorschach studies 
appearing before Cronbach's (1949 
of Rorschach 
the number of re- 
sponses, but assumed that all differ 
ences in 
tributed 
able. 


now 


critique research did 


not control for 
determinants could be at- 
to the experimenta! vari- 
To a large extent investigators 
attempt to partial out differ- 
the number of 
but an occasional study will still dis 
While most of the 


other statistical errors Cronbach dis 


ences in responses, 


regard this factor 


cussed occur far less frequently in 
later 
bilits 


source of error 


research, inflation of proba 


levels continues to be a major 
gn the 


studies cited here presented strong 


Despite these flaws in de 


evidence of situational and _ inter- 
personal influences in projective test 
ing. It is important. to note, how 
that the 


did not change with any ar 


ever, projective response 
d all con 
ditions imposed by the EF The use 
of drugs produced only minimal 
changes in the protocol and there was 
con flic ting evidence re garding the im 
portance of such physical differences 
and size. 


What appeared to be the crucial ele 
ment was the 


among Es as skin color, sex 
extent to which S's 
attitude toward the fotal testing situ 
ation was influenced by the experi 
Where the exper 
imental variable was peripheral to the 
examination, as in Coleman's (1947 
showing of a film the night before ad 
ministering the TAT, no 
eflect was introduced in the proto ol 


mental conditions 


ippres 1 ible 


when the condition was sufficiently 


unique and sufficiently contiguous to 
the testing session, as in the use of a 
waiting room decorated with pictures 
of nude women (Rabin, Nelson, & 
Clark, 1954), Ss evidently construed 
the experimental conditions to be a 
part of the total testing situation. 

There is considerable evidence that 
Ss in an unstructured situation will 
utilize all available cues to complete 
their assigned task. The S in the 
projective test setting will not only 
use those cues furnished by the ink 
blot or picture, but also those sup- 
plied by his feelings about the ex- 
aminer, those furnished by his needs, 
attitudes and fears, those implied in 
the instructions, the room, and previ- 
ous knowledge of the test, and those 
cues supplied consciously or uncon- 
sciously by E. When E faces the am- 
biguous situation of supplying mean- 
ing to a series of isolated, discrete re- 
sponses, he will not only rely on S's 
responses, but also on those cues fur- 
nished by his training and theoretical 
onrentation, needs and ex- 
pectations, his feelings about S and 
the constructions he places on S's 
test behavior and attitudes. In short, 
demonstrate that E 
and S behave as we should expect, 
considering our knowledge of behav- 
or in ambiguous settings. 

| hus, 


his own 


these studies 


the procedure that many 
clinicians hoped would serve as an 
X ray proves, on close examination, 
to function also as a mirror, reflecting 
impartially S, E, the situation and 
their interactions. This need not be 


a cause for despair, except for those 
who feel that E and situational influ- 
ences contaminate a protocol. These 
influences are not sources of error, 
however, but indications of adapta- 


tion to the task. One reason for the 
poor record of blind analysis as a pro- 
cedure for validating projective de- 
vices is that this method can utilize 
only a fraction of the material avail- 
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able in a protocol 
to eliminate interpersonal and situa- 
tional influence E might better make 
a more thorough search of his own 
attitudes and of S’s attitudes toward 
the test and the situation (Leventhal, 
Rosenblatt, Gluck, & Slepian, 1958 

The interpersonal situation ‘‘is not an 
evil. It should not be striven against 
As in psychoanalytic technique, 


Instead of trving 


this 
relationship must be regarded as in 
evitable, asa potentially signihcant 
influence 
tions, and as a possible goldmine of 
material for Scha- 
fer, 1954, p. 6 
The important 

area remain unsolved. What 
does experience have on E's 
tivity the 
what importance e is the psy 
health of S in his response to tl 
titudes of EF? 


on the patient's produc- 


interpretation” 
problems this 
effect 
to attitudes of S 


( hol 


Little is 
stood about the circun 
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prompt an S to rely heavily on inter- 
personal cues, nor do we know much 
of the forces acting on an E who is 
faced belligerent, or overly 

Most 
bulk of 


here indicate only 


with a 
cooperative or 


of all, 


suspicious 5S, 


important the great 
the studies cited 
that situational 


Vat fl 


interpersonal 
the 


any way describ 


and 


ibles influence projective 


protocol, without in 
ing how these variables impinge on 
Eand S. How S senses that E is hos 
tile and how E realizes S is trying to 
control him can only be determined 


by studying the interaction process 


itself. It is interesting to note that 


no study reviewed here used verba 


tim recordings of the testing session, 
despite the popularity of 


growing 


verbatit transcripts in research on 


psychotherapy. Hopefully, future re 


search « testing will i 
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NOTE ON THE MULTITRAIT-MULTIMETHOD MATRIX 


LLOYD G 


HUMPHREYS 


University of Illinois 


The recent article by Campbell 
and Fiske (1959) is stimulating and 
sound, but one of their conclusions 
can be supplemented to indicate a 
desirable direction for further re- 
search. They conclude as follows 
“Measures of the same trait should 
correlate higher with each other than 
they do with measures of different 
traits involving 
Ideally, these validity values should 
also be higher than the correlations 


separate methods 


Method 


among different traits measured by 
the same method.” There is no 
ing with their first 
their second is hedged by 
“‘ideally.”’ 
strong. It is the purpose of this note 
to show that the second criterion is 
better characterized as The 
degree of importance to be attached 


argu- 
criterion, and 
the use of 


Even so, the sec ond is too 


nice 


to it is simply a function of the num- 
ber of different methods that can be 
used to measure the trait 

The procedure required to handle 
the problem posed by correlations 
between measures of different traits, 
utilizing the same method, that are 
higher than the correlations between 


measures of the 


86 


Same trait across 


different methods is implicit in Spear- 


man. It has also been suggested by 
several measurement theorists subse- 
quent to Spearman, but has rarely 
been followed explicitly as a 


for test 


basis 
construction. Yet, consider- 
ing the present status of personality 
might 


clude that this procedure constitutes 


measurement, one well con 


our only hope in this area 
Consider the following four rows of 
a hypothetical rotated factor matrix 


Method Method Method Method Method 


I] It! 1\ V VI 


The correlation between Variables 
1 and 2 


the same trait 


assumed to measure 
16, but the 
correlation between 1 and 7, measur 
traits, is .64. Clearly 

Campbell and Fiske 
met, and by a very sub 
But now let us as- 
sume that Variables 3 through 6 
shown 


both 


is only 


ing different 
the ideal of 
(1959) is not 
stantial amount 
(not 
40 on 
lrait A, and each has a loading of .80 
on one of the 


ilso have loadings of 
succeeding methods 
Factors III through VI 
Variables 8 through 11 
40 on Trait B, with 
method loadings of 


factors 

Similarly, 
have loadings of 
80 on succeeding 
sum Variables 1 
Variables 7 


factors If we now 


through 6 and through 
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12, the two aggregates will have the of increasing the number of methods 
following factor loadings, as deter whith measure the trait in question, 
mined by the formula for correla the writer does not intend to convey 


tions of sums the impression that the problem is 


Method Method Method Method 
lil I\ V Vi 


easy one empirically. Quite the 

verse is true, but the difficulty of 

search should not deter us. After 

we can hardly point with pride 

tween the tw sures of or what we have accomplished in the 

thogonal traits 85, be tl nality realm in the attempt to 

have methods \v mo find good trait measures defined by 
while the correla mm Vv ha | ng methods 

fallible measure of tl tra reader should not conclude 

only .53. Even so, w or hat aggregating across methods to 

that our tv Tas, t have | ybtain better trait measures ts re- 

chometric characteristics which mal d to the personality realm. 

them potentially useful tools for stematic application of this pro- 

further researc! hes \ dure to aptitude measurement is 

Both could be further ilso desirable. Guilford’s analysis of 

the additio met the ability domain (1956) could serve 

| the basis for deciding which di- 

or dimensions should be 

across in constructing socially 

cientifically useful trait measures. 


{ ampbell ind Fiske 1 ld if t i in contrast toa point of view, 


procedure is to be suce i] md which is apparently held by Guil- 
depends entirely ! r abil rd, that recommends a separate 
devise enough methods of rr every cell in his table. Thus, 
nstructing a reasoning test, it 
ire interested ! might be desirable to aggregate 
methods required in a part lar icross methods, e.g., series, analogies, 
situation will depend on h yw th ind classification items; and across 
intercorrelations are whe content, e.g., words, numbers, fig- 
held constant and methods vary, a ures, letters, and objects. The fact 
opposed to how high the intercort that an ability can be fractionated is 
lations are when method is held co: insufficient basis for concluding that 
stant and traits vary hould be fractionated. 
In discussing so glibly the problem 
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